dev@glassfish.java.net

Re: latest GF build takes 90+ % cpu

From: Anissa Lam <Anissa.Lam_at_Sun.COM>
Date: Wed, 22 Apr 2009 09:10:22 -0700

Kedar Mhaswade wrote:
> Can you get a thread dump (kill -3 pid) for the server process when
> this happens? (I believe this is on Mac).
Please see attached.

thanks
Anissa
>
> -Kedar
>
> Anissa Lam wrote:
>> Hi,
>> I start noticing this yesterday. Once i start glassfish, (i use the
>> glassfish distribution), the cpu just jumps up to over 90% and stays
>> high up there until i kill it. I just did a svn update and rebuild
>> everything, same issue. Anyone sees this ?
>>
>> thanks
>> Anissa
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe_at_glassfish.dev.java.net
>> For additional commands, e-mail: dev-help_at_glassfish.dev.java.net
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe_at_glassfish.dev.java.net
> For additional commands, e-mail: dev-help_at_glassfish.dev.java.net
>



Apr 22, 2009 9:05:57 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info
INFO: JVM invocation command line:
/System/Library/Frameworks/JavaVM.framework/Versions/1.6.0/Home/bin/java
-cp
/Users/anilam/Awork/V3/v3/dist-gf/modules/glassfish.jar
-XX:+UnlockDiagnosticVMOptions
-XX:MaxPermSize=192m
-XX:NewRatio=2
-XX:+LogVMOutput
-XX:LogFile=/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1/logs/jvm.log
-Xmx512m
-client
-Djdbc.drivers=org.apache.derby.jdbc.ClientDriver
-Djavax.net.ssl.trustStore=/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1/config/cacerts.jks
-Djavax.net.ssl.keyStore=/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1/config/keystore.jks
-Djava.security.policy=/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1/config/server.policy
-Dcom.sun.aas.instanceRoot=/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1
-Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory
-Djava.security.auth.login.config=/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1/config/login.conf
-Djava.endorsed.dirs=/Users/anilam/Awork/V3/v3/dist-gf/lib/endorsed
-Dcom.sun.aas.installRoot=/Users/anilam/Awork/V3/v3/dist-gf
-Djava.ext.dirs=/System/Library/Frameworks/JavaVM.framework/Versions/1.6.0/Home/lib/ext:/System/Library/Frameworks/JavaVM.framework/Versions/1.6.0/Home/jre/lib/ext:/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1/lib/ext:/Users/anilam/Awork/V3/v3/dist-gf/javadb/lib
com.sun.enterprise.glassfish.bootstrap.ASMain
-domainname
domain1
-instancename
server
-watchdog
true
-verbose
true
-debug
false
-domaindir
/Users/anilam/Awork/V3/v3/dist-gf/domains/domain1
Watchdog is running. The Domain is remote-restart enabled.
Apr 22, 2009 9:05:57 AM com.sun.enterprise.admin.launcher.GFLauncherLogger info
INFO: Successfully launched in 31 msec.
Apr 22, 2009 9:05:57 AM com.sun.enterprise.glassfish.bootstrap.ASMain main
INFO: Launching GlassFish on Apache Felix OSGi platform

Welcome to Felix.
=================

felix.fileinstall.poll (ms) 5000
felix.fileinstall.dir /Users/anilam/Awork/V3/v3/dist-gf/modules
felix.fileinstall.debug 1
felix.fileinstall.bundles.new.start false
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.common.glassfish-mbeanserver [93]
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.core.kernel [150]
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.common.util [40]
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle com.sun.enterprise.config [44]
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.admin.config-api [43]
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.branding [30]
Apr 22, 2009 9:06:02 AM AppServerStartup run
INFO: [Thread[GlassFish Kernel Main Thread,5,main]] started
Apr 22, 2009 9:06:02 AM com.sun.enterprise.v3.services.impl.LogManagerService postConstruct
INFO: Starting GlassFish Application Server.
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.common.internal-api [114]
Apr 22, 2009 9:06:02 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.registration.glassfish-registration [95]
Apr 22, 2009 9:06:03 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.jms.core [135]
Apr 22, 2009 9:06:03 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.connectors.runtime [48]
Apr 22, 2009 9:06:03 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.common.container-common [57]
Apr 22, 2009 9:06:03 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.deployment.autodeploy [61]
Apr 22, 2009 9:06:03 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.common.glassfish-naming [94]
Apr 22, 2009 9:06:03 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.transaction.jts [149]
Apr 22, 2009 9:06:04 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.transaction.jta [148]
Apr 22, 2009 9:06:04 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.common.glassfish-api [81]
Apr 22, 2009 9:06:04 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.ejb.ejb-container [67]
Apr 22, 2009 9:06:04 AM org.glassfish.admin.mbeanserver.ConnectorStartupService$ConnectorsStarterThread startConnector
INFO: Started JMXConnector, JMXService URL = service:jmx:rmi:///jndi/rmi://192.168.1.102:8686/jmxrmi
Apr 22, 2009 9:06:05 AM com.sun.enterprise.transaction.JavaEETransactionManagerSimplified initDelegates
INFO: Using com.sun.enterprise.transaction.jts.JavaEETransactionManagerJTSDelegate as the delegate
Apr 22, 2009 9:06:05 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.connectors.work-management [201]
Apr 22, 2009 9:06:05 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.connectors.internal-api [47]
Apr 22, 2009 9:06:05 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.flashlight.framework [73]
Apr 22, 2009 9:06:05 AM OSGiModuleImpl start
INFO: Started bundle com.sun.grizzly.grizzly-config [100]
Apr 22, 2009 9:06:05 AM com.sun.enterprise.v3.services.impl.GrizzlyProxy start
INFO: Listening on port 8080
Apr 22, 2009 9:06:05 AM com.sun.enterprise.v3.services.impl.GrizzlyService createNetworkProxy
INFO: Network listener http-listener-2 on port 8181 disabled per domain.xml
Apr 22, 2009 9:06:05 AM com.sun.enterprise.v3.services.impl.GrizzlyProxy start
INFO: Listening on port 4848
Apr 22, 2009 9:06:05 AM OSGiModuleImpl start
INFO: Started bundle org.glassfish.deployment.common [63]
Apr 22, 2009 9:06:05 AM com.sun.enterprise.v3.server.AppServerStartup run
INFO: GlassFish v3 startup time : Felix(4598ms) startup services(3363ms) total(7961ms)




2009-04-22 09:06:31
Full thread dump Java HotSpot(TM) 64-Bit Server VM (1.6.0_07-b06-57 mixed mode):

"domain1-StderrDrainer" daemon prio=5 tid=0x00000001018c9800 nid=0x110c27000 runnable [0x0000000110c26000..0x0000000110c26ad0]
   java.lang.Thread.State: RUNNABLE
        at java.io.FileInputStream.readBytes(Native Method)
        at java.io.FileInputStream.read(FileInputStream.java:199)
        at java.lang.UNIXProcess$DeferredCloseInputStream.read(UNIXProcess.java:227)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        - locked <0x0000000105003b40> (a java.io.BufferedInputStream)
        at java.io.FilterInputStream.read(FilterInputStream.java:90)
        at com.sun.enterprise.universal.process.ProcessStreamDrainerWorker.run(ProcessStreamDrainerWorker.java:69)
        at java.lang.Thread.run(Thread.java:637)

"domain1-StdoutDrainer" daemon prio=5 tid=0x00000001018c8800 nid=0x110b24000 runnable [0x0000000110b23000..0x0000000110b23ad0]
   java.lang.Thread.State: RUNNABLE
        at java.io.FileInputStream.readBytes(Native Method)
        at java.io.FileInputStream.read(FileInputStream.java:199)
        at java.lang.UNIXProcess$DeferredCloseInputStream.read(UNIXProcess.java:227)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        - locked <0x0000000105243f48> (a java.io.BufferedInputStream)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
        - locked <0x0000000105001518> (a java.io.BufferedInputStream)
        at java.io.FilterInputStream.read(FilterInputStream.java:90)
        at com.sun.enterprise.universal.process.ProcessStreamDrainerWorker.run(ProcessStreamDrainerWorker.java:69)
        at java.lang.Thread.run(Thread.java:637)

"process reaper" daemon prio=5 tid=0x00000001018c7000 nid=0x110a21000 runnable [0x0000000110a20000..0x0000000110a20ad0]
   java.lang.Thread.State: RUNNABLE
        at java.lang.UNIXProcess.waitForProcessExit(Native Method)
        at java.lang.UNIXProcess.access$900(UNIXProcess.java:17)
        at java.lang.UNIXProcess$2$1.run(UNIXProcess.java:86)

"Low Memory Detector" daemon prio=5 tid=0x0000000101844800 nid=0x10fff5000 runnable [0x0000000000000000..0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=9 tid=0x0000000101843800 nid=0x10fef2000 waiting on condition [0x0000000000000000..0x000000010fef03e0]
   java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=9 tid=0x0000000101841800 nid=0x10fdef000 waiting on condition [0x0000000000000000..0x000000010fded3e0]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=9 tid=0x0000000101841000 nid=0x10fcec000 waiting on condition [0x0000000000000000..0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=8 tid=0x0000000101829800 nid=0x10fbe9000 in Object.wait() [0x000000010fbe8000..0x000000010fbe8ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000106c2bf90> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x0000000106c2bf90> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x0000000101828800 nid=0x10fae6000 in Object.wait() [0x000000010fae5000..0x000000010fae5ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000106c2c070> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:485)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
        - locked <0x0000000106c2c070> (a java.lang.ref.Reference$Lock)

"main" prio=5 tid=0x0000000101801000 nid=0x100401000 in Object.wait() [0x0000000100400000..0x0000000100400c70]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000001052400b0> (a java.lang.UNIXProcess)
        at java.lang.Object.wait(Object.java:485)
        at java.lang.UNIXProcess.waitFor(UNIXProcess.java:115)
        - locked <0x00000001052400b0> (a java.lang.UNIXProcess)
        at com.sun.enterprise.admin.launcher.GFLauncher.wait(GFLauncher.java:295)
        at com.sun.enterprise.admin.launcher.GFLauncher.launchInstance(GFLauncher.java:248)
        at com.sun.enterprise.admin.launcher.GFDomainLauncher.internalLaunch(GFDomainLauncher.java:47)
        at com.sun.enterprise.admin.launcher.GFLauncher.launch(GFLauncher.java:68)
        - locked <0x0000000106c7ada0> (a com.sun.enterprise.admin.launcher.GFDomainLauncher)
        at com.sun.enterprise.admin.cli.StartDomainCommand.runCommandNotEmbedded(StartDomainCommand.java:96)
        at com.sun.enterprise.admin.cli.StartDomainCommand.runCommand(StartDomainCommand.java:46)
        at com.sun.enterprise.cli.framework.CLIMain.invokeCommand(CLIMain.java:160)
        at com.sun.enterprise.admin.cli.AsadminMain.local(AsadminMain.java:135)
        at com.sun.enterprise.admin.cli.AsadminMain.main(AsadminMain.java:67)

"VM Thread" prio=9 tid=0x0000000101820800 nid=0x1007dc000 runnable

"VM Periodic Task Thread" prio=10 tid=0x0000000101846000 nid=0x1100f8000 waiting on condition

"Exception Catcher Thread" prio=10 tid=0x0000000101802000 nid=0x100504000 runnable
JNI global references: 653

Heap
 def new generation total 2304K, used 398K [0x0000000105000000, 0x0000000105290000, 0x0000000106c00000)
  eden space 1984K, 7% used [0x0000000105000000, 0x0000000105026f90, 0x00000001051f0000)
  from space 320K, 75% used [0x0000000105240000, 0x000000010527c8b0, 0x0000000105290000)
  to space 320K, 0% used [0x00000001051f0000, 0x00000001051f0000, 0x0000000105240000)
 tenured generation total 5312K, used 736K [0x0000000106c00000, 0x0000000107130000, 0x000000010a400000)
   the space 5312K, 13% used [0x0000000106c00000, 0x0000000106cb82a8, 0x0000000106cb8400, 0x0000000107130000)
 compacting perm gen total 21248K, used 8707K [0x000000010a400000, 0x000000010b8c0000, 0x000000010f800000)
   the space 21248K, 40% used [0x000000010a400000, 0x000000010ac80d20, 0x000000010ac80e00, 0x000000010b8c0000)
No shared spaces configured.

2009-04-22 09:06:31
Full thread dump Java HotSpot(TM) 64-Bit Server VM (1.6.0_07-b06-57 mixed mode):

"pool-10-thread-1" daemon prio=5 tid=0x0000000101b10800 nid=0x135cdf000 waiting on condition [0x0000000135cde000..0x0000000135cdead0]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x0000000110826970> (a java.util.concurrent.SynchronousQueue$TransferStack)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:944)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        at java.lang.Thread.run(Thread.java:637)

"pool-9-thread-1" daemon prio=5 tid=0x0000000101b0f800 nid=0x135bdc000 waiting on condition [0x0000000135bdb000..0x0000000135bdbad0]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x0000000110826970> (a java.util.concurrent.SynchronousQueue$TransferStack)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:944)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        at java.lang.Thread.run(Thread.java:637)

"GrizzlySelectorRunner-TCP" prio=5 tid=0x0000000101afc800 nid=0x135ad9000 runnable [0x0000000135ad8000..0x0000000135ad8ad0]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        - locked <0x0000000110d91d88> (a sun.nio.ch.Util$1)
        - locked <0x0000000110d91da0> (a java.util.Collections$UnmodifiableSet)
        - locked <0x0000000110d91d10> (a sun.nio.ch.KQueueSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:489)
        at com.sun.grizzly.Controller.doSelect(Controller.java:328)
        at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:90)
        at java.lang.Thread.run(Thread.java:637)

"GrizzlySelectorRunner-TCP" prio=5 tid=0x0000000101afb800 nid=0x1359d6000 runnable [0x00000001359d5000..0x00000001359d5ad0]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
        at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
        - locked <0x0000000110d91f08> (a sun.nio.ch.Util$1)
        - locked <0x0000000110d91f20> (a java.util.Collections$UnmodifiableSet)
        - locked <0x0000000110d91e90> (a sun.nio.ch.KQueueSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
        at com.sun.grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:489)
        at com.sun.grizzly.Controller.doSelect(Controller.java:328)
        at com.sun.grizzly.SelectorHandlerRunner.run(SelectorHandlerRunner.java:90)
        at java.lang.Thread.run(Thread.java:637)

"Thread-8" prio=5 tid=0x0000000101ae0000 nid=0x1358d3000 in Object.wait() [0x00000001358d2000..0x00000001358d2ad0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000110c02e10> (a java.util.concurrent.atomic.AtomicInteger)
        at com.sun.grizzly.Controller.waitUntilSeletorHandlersStop(Controller.java:1221)
        - locked <0x0000000110c02e10> (a java.util.concurrent.atomic.AtomicInteger)
        at com.sun.grizzly.Controller.start(Controller.java:968)
        at com.sun.grizzly.http.SelectorThread.startListener(SelectorThread.java:1180)
        - locked <0x0000000110c02e28> (a java.lang.Object)
        at com.sun.grizzly.http.SelectorThread.run(SelectorThread.java:1031)
        at com.sun.grizzly.http.SelectorThread.startEndpoint(SelectorThread.java:1107)
        at com.sun.enterprise.v3.services.impl.GrizzlyProxy$1.run(GrizzlyProxy.java:211)

"Thread-7" prio=5 tid=0x0000000101ade000 nid=0x135427000 in Object.wait() [0x0000000135426000..0x0000000135426ad0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000110c030e8> (a java.util.concurrent.atomic.AtomicInteger)
        at com.sun.grizzly.Controller.waitUntilSeletorHandlersStop(Controller.java:1221)
        - locked <0x0000000110c030e8> (a java.util.concurrent.atomic.AtomicInteger)
        at com.sun.grizzly.Controller.start(Controller.java:968)
        at com.sun.grizzly.http.SelectorThread.startListener(SelectorThread.java:1180)
        - locked <0x0000000110c03100> (a java.lang.Object)
        at com.sun.grizzly.http.SelectorThread.run(SelectorThread.java:1031)
        at com.sun.grizzly.http.SelectorThread.startEndpoint(SelectorThread.java:1107)
        at com.sun.enterprise.v3.services.impl.GrizzlyProxy$1.run(GrizzlyProxy.java:211)

"transaction-manager" daemon prio=5 tid=0x00000001019d0000 nid=0x1343b2000 in Object.wait() [0x00000001343b1000..0x00000001343b1ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000110abab60> (a java.util.TaskQueue)
        at java.lang.Object.wait(Object.java:485)
        at java.util.TimerThread.mainLoop(Timer.java:483)
        - locked <0x0000000110abab60> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"RMI TCP Connection(idle)" daemon prio=5 tid=0x0000000101aa3800 nid=0x1357d0000 waiting on condition [0x00000001357cf000..0x00000001357cfad0]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x00000001109af700> (a java.util.concurrent.SynchronousQueue$TransferStack)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:944)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        at java.lang.Thread.run(Thread.java:637)

"RMI RenewClean-[192.168.1.102:53483]" daemon prio=5 tid=0x0000000101a9c800 nid=0x1355c6000 in Object.wait() [0x00000001355c5000..0x00000001355c5ad0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0000000110abd028> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x0000000110abd028> (a java.lang.ref.ReferenceQueue$Lock)
        at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516)
        at java.lang.Thread.run(Thread.java:637)

"RMI Scheduler(0)" daemon prio=5 tid=0x0000000101a8e000 nid=0x1356cd000 waiting on condition [0x00000001356cc000..0x00000001356ccad0]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x00000001109b1b28> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:582)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:575)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:946)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        at java.lang.Thread.run(Thread.java:637)

"RMI TCP Connection(idle)" daemon prio=5 tid=0x0000000101a83000 nid=0x135324000 waiting on condition [0x0000000135323000..0x0000000135323ad0]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x00000001109af700> (a java.util.concurrent.SynchronousQueue$TransferStack)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:944)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        at java.lang.Thread.run(Thread.java:637)

"GC Daemon" daemon prio=2 tid=0x0000000101a7a000 nid=0x135221000 in Object.wait() [0x0000000135220000..0x0000000135220ad0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000001109a2448> (a sun.misc.GC$LatencyLock)
        at sun.misc.GC$Daemon.run(GC.java:100)
        - locked <0x00000001109a2448> (a sun.misc.GC$LatencyLock)

"RMI Reaper" prio=5 tid=0x0000000101a77000 nid=0x13511e000 in Object.wait() [0x000000013511d000..0x000000013511dad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000001109a2500> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x00000001109a2500> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:333)
        at java.lang.Thread.run(Thread.java:637)

"RMI TCP Accept-0" daemon prio=5 tid=0x0000000101a76800 nid=0x13501b000 runnable [0x000000013501a000..0x000000013501aad0]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x00000001109a2608> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:453)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
        at java.lang.Thread.run(Thread.java:637)

"RMI TCP Accept-8686" daemon prio=5 tid=0x0000000101a66800 nid=0x134c89000 runnable [0x0000000134c88000..0x0000000134c88ad0]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x00000001109a28b8> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:453)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
        at java.lang.Thread.run(Thread.java:637)

"AutoDeployer" daemon prio=5 tid=0x0000000101a3f000 nid=0x134f18000 in Object.wait() [0x0000000134f17000..0x0000000134f17ad0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000011098f2f8> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:509)
        - locked <0x000000011098f2f8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"DynamicReloader" daemon prio=5 tid=0x00000001019ed000 nid=0x134db4000 in Object.wait() [0x0000000134db3000..0x0000000134db3ad0]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000011092ada8> (a java.util.TaskQueue)
        at java.util.TimerThread.mainLoop(Timer.java:509)
        - locked <0x000000011092ada8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:462)

"pool-1-thread-5" prio=5 tid=0x00000001019d1000 nid=0x134b07000 waiting on condition [0x0000000134b06000..0x0000000134b06ad0]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x000000011090dcd0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
        at org.jvnet.hk2.config.Transactions$Notifier$1.run(Transactions.java:142)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:637)

"pool-3-thread-1" daemon prio=5 tid=0x0000000101986000 nid=0x134a04000 waiting on condition [0x0000000134a03000..0x0000000134a03ad0]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x000000011081c670> (a java.util.concurrent.SynchronousQueue$TransferStack)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:944)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        at java.lang.Thread.run(Thread.java:637)

"Thread-1" prio=5 tid=0x0000000101981800 nid=0x134901000 runnable [0x0000000134900000..0x0000000134900ad0]
   java.lang.Thread.State: RUNNABLE
        at java.util.logging.StreamHandler.flush(StreamHandler.java:225)
        - locked <0x0000000110867be8> (a com.sun.enterprise.server.logging.GFFileHandler)
        at com.sun.enterprise.server.logging.GFFileHandler.log(GFFileHandler.java:498)
        at com.sun.enterprise.server.logging.GFFileHandler$3.run(GFFileHandler.java:246)

"pool-2-thread-1" daemon prio=5 tid=0x000000010197d800 nid=0x134531000 waiting on condition [0x0000000134530000..0x0000000134530ad0]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x0000000110867d50> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:582)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:575)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:946)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        at java.lang.Thread.run(Thread.java:637)

"GlassFish Kernel Main Thread" prio=5 tid=0x0000000101971800 nid=0x133fc9000 in Object.wait() [0x0000000133fc8000..0x0000000133fc8ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000001107e1dd8> (a com.sun.enterprise.v3.server.AppServerStartup$1)
        at java.lang.Object.wait(Object.java:485)
        at com.sun.enterprise.v3.server.AppServerStartup$1.run(AppServerStartup.java:130)
        - locked <0x00000001107e1dd8> (a com.sun.enterprise.v3.server.AppServerStartup$1)

"pool-1-thread-4" prio=5 tid=0x0000000101959000 nid=0x133c91000 waiting on condition [0x0000000133c90000..0x0000000133c90ad0]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x00000001106f61f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
        at org.jvnet.hk2.config.Transactions$Notifier$1.run(Transactions.java:142)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:637)

"pool-1-thread-3" prio=5 tid=0x0000000101958800 nid=0x133b8e000 waiting on condition [0x0000000133b8d000..0x0000000133b8dad0]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x00000001106f6448> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
        at org.jvnet.hk2.config.Transactions$Notifier$1.run(Transactions.java:142)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:637)

"pool-1-thread-2" prio=5 tid=0x0000000101952000 nid=0x133a45000 waiting on condition [0x0000000133a44000..0x0000000133a44ad0]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x00000001106f66a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
        at org.jvnet.hk2.config.Transactions$Notifier$1.run(Transactions.java:142)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:637)

"pool-1-thread-1" prio=5 tid=0x0000000101950800 nid=0x133942000 waiting on condition [0x0000000133941000..0x0000000133941ad0]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for <0x00000001106f68f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
        at org.jvnet.hk2.config.Transactions$Notifier$1.run(Transactions.java:142)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
        at java.lang.Thread.run(Thread.java:637)

"{felix.fileinstall.poll=5000, felix.fileinstall.bundles.new.start=false, felix.fileinstall.dir=/Users/anilam/Awork/V3/v3/dist-gf/modules/, felix.fileinstall.debug=1}" daemon prio=5 tid=0x00000001018fa000 nid=0x133256000 waiting on condition [0x0000000133255000..0x0000000133255ad0]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at org.apache.felix.fileinstall.DirectoryWatcher.run(DirectoryWatcher.java:122)

"Configuration Updater" daemon prio=5 tid=0x00000001018f8000 nid=0x133153000 in Object.wait() [0x0000000133152000..0x0000000133152ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000011025e640> (a java.util.LinkedList)
        at java.lang.Object.wait(Object.java:485)
        at org.apache.felix.cm.impl.UpdateThread.run(UpdateThread.java:67)
        - locked <0x000000011025e640> (a java.util.LinkedList)

"telnetconsole.Listener" daemon prio=5 tid=0x00000001018e6800 nid=0x133050000 runnable [0x000000013304f000..0x000000013304fad0]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
        - locked <0x000000011025e728> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:453)
        at java.net.ServerSocket.accept(ServerSocket.java:421)
        at org.apache.felix.shell.remote.Listener$Acceptor.run(Listener.java:137)
        at java.lang.Thread.run(Thread.java:637)

"FelixPackageAdmin" daemon prio=5 tid=0x00000001018a6800 nid=0x1328ba000 in Object.wait() [0x00000001328b9000..0x00000001328b9ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000010fb3f1b8> (a org.apache.felix.framework.PackageAdminImpl)
        at java.lang.Object.wait(Object.java:485)
        at org.apache.felix.framework.PackageAdminImpl.run(PackageAdminImpl.java:314)
        - locked <0x000000010fb3f1b8> (a org.apache.felix.framework.PackageAdminImpl)
        at java.lang.Thread.run(Thread.java:637)

"FelixStartLevel" daemon prio=5 tid=0x00000001018a5800 nid=0x1325fc000 in Object.wait() [0x00000001325fb000..0x00000001325fbad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000010fb3fac8> (a java.util.ArrayList)
        at java.lang.Object.wait(Object.java:485)
        at org.apache.felix.framework.StartLevelImpl.run(StartLevelImpl.java:241)
        - locked <0x000000010fb3fac8> (a java.util.ArrayList)
        at java.lang.Thread.run(Thread.java:637)

"FelixDispatchQueue" daemon prio=5 tid=0x000000010189f800 nid=0x1327b7000 in Object.wait() [0x00000001327b6000..0x00000001327b6ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000010fb3fb98> (a java.util.ArrayList)
        at java.lang.Object.wait(Object.java:485)
        at org.apache.felix.framework.util.EventDispatcher.run(EventDispatcher.java:875)
        - locked <0x000000010fb3fb98> (a java.util.ArrayList)
        at org.apache.felix.framework.util.EventDispatcher.access$000(EventDispatcher.java:50)
        at org.apache.felix.framework.util.EventDispatcher$1.run(EventDispatcher.java:102)
        at java.lang.Thread.run(Thread.java:637)

"OSGi Framework Launcher" daemon prio=5 tid=0x0000000101885000 nid=0x13201a000 in Object.wait() [0x0000000132018000..0x0000000132019ad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000010fb42f30> (a org.apache.felix.framework.util.ThreadGate)
        at org.apache.felix.framework.util.ThreadGate.await(ThreadGate.java:48)
        - locked <0x000000010fb42f30> (a org.apache.felix.framework.util.ThreadGate)
        at org.apache.felix.framework.Felix.waitForStop(Felix.java:785)
        at org.apache.felix.main.Main.main(Main.java:215)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.glassfish.bootstrap.ASMainFelix$1.run(ASMainFelix.java:91)
        at java.lang.Thread.run(Thread.java:637)

"Low Memory Detector" daemon prio=5 tid=0x0000000101844800 nid=0x131983000 runnable [0x0000000000000000..0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"CompilerThread1" daemon prio=9 tid=0x0000000101843000 nid=0x131880000 waiting on condition [0x0000000000000000..0x000000013187e3e0]
   java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=9 tid=0x0000000101841800 nid=0x13177d000 waiting on condition [0x0000000000000000..0x000000013177b3e0]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=9 tid=0x0000000101841000 nid=0x13167a000 waiting on condition [0x0000000000000000..0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=8 tid=0x0000000101829800 nid=0x131560000 in Object.wait() [0x000000013155f000..0x000000013155fad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000010fac5a98> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
        - locked <0x000000010fac5a98> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x0000000101828800 nid=0x13145d000 in Object.wait() [0x000000013145c000..0x000000013145cad0]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000010fac5710> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:485)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
        - locked <0x000000010fac5710> (a java.lang.ref.Reference$Lock)

"main" prio=5 tid=0x0000000101801000 nid=0x100401000 in Object.wait() [0x0000000100400000..0x0000000100400c40]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x000000010fb14150> (a java.lang.Thread)
        at java.lang.Thread.join(Thread.java:1161)
        - locked <0x000000010fb14150> (a java.lang.Thread)
        at java.lang.Thread.join(Thread.java:1214)
        at com.sun.enterprise.glassfish.bootstrap.ASMainFelix.launchOSGiFW(ASMainFelix.java:110)
        at com.sun.enterprise.glassfish.bootstrap.ASMainOSGi.run(ASMainOSGi.java:137)
        at com.sun.enterprise.glassfish.bootstrap.ASMain.main(ASMain.java:65)

"VM Thread" prio=9 tid=0x0000000101820800 nid=0x13135a000 runnable

"VM Periodic Task Thread" prio=10 tid=0x0000000101846000 nid=0x131a86000 waiting on condition

"Exception Catcher Thread" prio=10 tid=0x0000000101802000 nid=0x100504000 runnable
JNI global references: 1028

Heap
 def new generation total 11392K, used 8464K [0x0000000105000000, 0x0000000105cb0000, 0x000000010faa0000)
  eden space 9792K, 86% used [0x0000000105000000, 0x0000000105844010, 0x0000000105990000)
  from space 1600K, 0% used [0x0000000105990000, 0x0000000105990028, 0x0000000105b20000)
  to space 1600K, 0% used [0x0000000105b20000, 0x0000000105b20000, 0x0000000105cb0000)
 tenured generation total 25840K, used 19984K [0x000000010faa0000, 0x00000001113dc000, 0x0000000125000000)
   the space 25840K, 77% used [0x000000010faa0000, 0x0000000110e241b0, 0x0000000110e24200, 0x00000001113dc000)
 compacting perm gen total 21248K, used 20800K [0x0000000125000000, 0x00000001264c0000, 0x0000000131000000)
   the space 21248K, 97% used [0x0000000125000000, 0x0000000126450180, 0x0000000126450200, 0x00000001264c0000)
No shared spaces configured.