dev@glassfish.java.net

Re: deadlock in LogManager

From: Lloyd Chambers <Lloyd.Chambers_at_Sun.COM>
Date: Mon, 27 Apr 2009 11:04:16 -0700

I'd prefer you commit it, Carla.

Lloyd

On Apr 24, 2009, at 4:59 PM, Carla Mott wrote:

> Thanks Lloyd. Do you want to commit? I can do it if not.
>
> Carla
>
> Lloyd Chambers wrote:
>> Tried some more...all appears good.
>> I recommend committing this fix as I was seeing hangs at startup
>> 50% of the time today.
>> Lloyd
>> On Apr 24, 2009, at 4:47 PM, Lloyd Chambers wrote:
>>> I made the change, and so far it has not deadlocked.
>>>
>>>
>>> llcMP:common llc$ svn diff common-util
>>> Index: common-util/src/main/java/com/sun/logging/LogDomains.java
>>> ===================================================================
>>> --- common-util/src/main/java/com/sun/logging/LogDomains.java
>>> (revision 26614)
>>> +++ common-util/src/main/java/com/sun/logging/LogDomains.java
>>> (working copy)
>>> @@ -241,7 +241,7 @@
>>> * @return
>>> */
>>> - public static Logger getLogger(final Class clazz, final
>>> String name) {
>>> + public static synchronized Logger getLogger(final Class
>>> clazz, final String name) {
>>> final ClassLoader cloader =clazz.getClassLoader();
>>> Logger l = LogManager.getLogManager().getLogger(name);
>>>
>>>
>>> Lloyd
>>>
>>> On Apr 24, 2009, at 4:42 PM, Carla Mott wrote:
>>>
>>>> LogDomains.java in common/common-util. That would be great since
>>>> I can make the change but I almost never see the deadlock. Let
>>>> me know what you find or if you want help.
>>>>
>>>> Carla
>>>>
>>>> Lloyd Chambers wrote:
>>>>> Which class/method is that? (I'd like to try it, deadlocks are
>>>>> happening half the time when I start the server)
>>>>> Lloyd
>>>>> On Apr 24, 2009, at 2:43 PM, Jerome Dochez wrote:
>>>>>> I suggested you need to protect the entire method rather than
>>>>>> the logger creation like I initially did, this should take care
>>>>>> of it.
>>>>>>
>>>>>> On Apr 24, 2009, at 2:40 PM, Carla Mott wrote:
>>>>>>
>>>>>>> Correct there is no update yet for those of us running on a
>>>>>>> Mac. Jerome recently tried updating the code to try and
>>>>>>> prevent this from happening but it still does though hopefully
>>>>>>> less often. I'll have to look at this further.
>>>>>>>
>>>>>>> Not sure when the update with the bug fix will be available
>>>>>>> for Macs.
>>>>>>>
>>>>>>> Carla
>>>>>>>
>>>>>>> Lloyd Chambers wrote:
>>>>>>>> This is on Mac OS X, 10.5.6. I don't think there is update
>>>>>>>> 11 available for it yet.
>>>>>>>> llcMP:amx-config-impl llc$ java -version
>>>>>>>> java version "1.6.0_07"
>>>>>>>> Java(TM) SE Runtime Environment (build 1.6.0_07-b06-153)
>>>>>>>> Java HotSpot(TM) 64-Bit Server VM (build 1.6.0_07-b06-57,
>>>>>>>> mixed mode)
>>>>>>>> On Apr 24, 2009, at 1:57 PM, Carla Mott wrote:
>>>>>>>>> Looks like it could be the same thing. What version of the
>>>>>>>>> JDK are you running? The fix is in JDK 6u11. If you are
>>>>>>>>> running that version of the JDK then we still have an issue.
>>>>>>>>>
>>>>>>>>> carla
>>>>>>>>>
>>>>>>>>> Lloyd Chambers wrote:
>>>>>>>>>> While testing some code today, I came across this deadlock
>>>>>>>>>> in LogManager.
>>>>>>>>>> Is this a JDK bug, or a bug due to something we've inserted
>>>>>>>>>> into the logging mechanism?
>>>>>>>>>> ^CThe domain was stopped.
>>>>>>>>>> llcMP:code llc$ r3
>>>>>>>>>> Apr 24, 2009 12:14:51 PM
>>>>>>>>>> com.sun.enterprise.admin.launcher.GFLauncherLogger info
>>>>>>>>>> INFO: JVM invocation command line:
>>>>>>>>>> /System/Library/Frameworks/JavaVM.framework/Versions/1.6.0/
>>>>>>>>>> Home/bin/java
>>>>>>>>>> -cp
>>>>>>>>>> /work/v3/glassfishv3/glassfish/modules/glassfish.jar
>>>>>>>>>> -XX:+UnlockDiagnosticVMOptions
>>>>>>>>>> -XX:MaxPermSize=192m
>>>>>>>>>> -XX:NewRatio=2
>>>>>>>>>> -XX:+LogVMOutput
>>>>>>>>>> -XX:LogFile=/work/v3/glassfishv3/glassfish/domains/domain1/
>>>>>>>>>> logs/jvm.log
>>>>>>>>>> -Xmx512m
>>>>>>>>>> -client
>>>>>>>>>> -Djdbc.drivers=org.apache.derby.jdbc.ClientDriver
>>>>>>>>>> -Djavax.net.ssl.trustStore=/work/v3/glassfishv3/glassfish/
>>>>>>>>>> domains/domain1/config/cacerts.jks -
>>>>>>>>>> Djavax.net.ssl.keyStore=/work/v3/glassfishv3/glassfish/
>>>>>>>>>> domains/domain1/config/keystore.jks -Djava.security.policy=/
>>>>>>>>>> work/v3/glassfishv3/glassfish/domains/domain1/config/
>>>>>>>>>> server.policy -Dcom.sun.aas.instanceRoot=/work/v3/
>>>>>>>>>> glassfishv3/glassfish/domains/domain1
>>>>>>>>>> -
>>>>>>>>>> Dcom
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .config
>>>>>>>>>> .config_environment_factory_class
>>>>>>>>>> =
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .config.serverbeans.AppserverConfigEnvironmentFactory -
>>>>>>>>>> Djava.security.auth.login.config=/work/v3/glassfishv3/
>>>>>>>>>> glassfish/domains/domain1/config/login.conf -
>>>>>>>>>> Djava.endorsed.dirs=/work/v3/glassfishv3/glassfish/lib/
>>>>>>>>>> endorsed
>>>>>>>>>> -Dcom.sun.aas.installRoot=/work/v3/glassfishv3/glassfish
>>>>>>>>>> -Djava.ext.dirs=/System/Library/Frameworks/JavaVM.framework/
>>>>>>>>>> Versions/1.6.0/Home/lib/ext:/System/Library/Frameworks/
>>>>>>>>>> JavaVM.framework/Versions/1.6.0/Home/jre/lib/ext:/work/v3/
>>>>>>>>>> glassfishv3/glassfish/domains/domain1/lib/ext:/work/v3/
>>>>>>>>>> glassfishv3/javadb/lib
>>>>>>>>>> com.sun.enterprise.glassfish.bootstrap.ASMain
>>>>>>>>>> -domainname
>>>>>>>>>> domain1
>>>>>>>>>> -asadmin-args
>>>>>>>>>> start-domain,,,--verbose
>>>>>>>>>> -instancename
>>>>>>>>>> server
>>>>>>>>>> -watchdog
>>>>>>>>>> true
>>>>>>>>>> -verbose
>>>>>>>>>> true
>>>>>>>>>> -debug
>>>>>>>>>> false
>>>>>>>>>> -asadmin-classpath
>>>>>>>>>> /v3/glassfishv3/bin/../glassfish/modules/admin-cli.jar
>>>>>>>>>> -asadmin-classname
>>>>>>>>>> com.sun.enterprise.admin.cli.AsadminMain
>>>>>>>>>> -domaindir
>>>>>>>>>> /work/v3/glassfishv3/glassfish/domains/domain1
>>>>>>>>>> Watchdog is running. The Domain is remote-restart enabled.
>>>>>>>>>> Apr 24, 2009 12:14:51 PM
>>>>>>>>>> com.sun.enterprise.admin.launcher.GFLauncherLogger info
>>>>>>>>>> INFO: Successfully launched in 13 msec.
>>>>>>>>>> Apr 24, 2009 12:14:51 PM
>>>>>>>>>> com.sun.enterprise.glassfish.bootstrap.ASMain main
>>>>>>>>>> INFO: Launching GlassFish on Apache Felix OSGi platform
>>>>>>>>>> Welcome to Felix.
>>>>>>>>>> =================
>>>>>>>>>> felix.fileinstall.poll (ms) 5000
>>>>>>>>>> felix.fileinstall.dir /work/v3/glassfishv3/
>>>>>>>>>> glassfish/modules
>>>>>>>>>> felix.fileinstall.debug 1
>>>>>>>>>> felix.fileinstall.bundles.new.start false
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.glassfish-
>>>>>>>>>> mbeanserver [103]
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.core.kernel [164]
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.util [48]
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle com.sun.enterprise.config [53]
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.admin.config-api [52]
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.branding [37]
>>>>>>>>>> Apr 24, 2009 12:14:52 PM AppServerStartup run
>>>>>>>>>> INFO: [Thread[GlassFish Kernel Main Thread,5,main]] started
>>>>>>>>>> Apr 24, 2009 12:14:52 PM
>>>>>>>>>> com.sun.enterprise.v3.services.impl.LogManagerService
>>>>>>>>>> postConstruct
>>>>>>>>>> INFO: Starting GlassFish Application Server.
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.internal-api [127]
>>>>>>>>>> Apr 24, 2009 12:14:52 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.registration.glassfish-
>>>>>>>>>> registration [106]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.jms.core [148]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.connectors.runtime [57]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.glassfish-naming
>>>>>>>>>> [105]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.transaction.jta [162]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.glassfish-api [91]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.container-common
>>>>>>>>>> [67]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.ejb.ejb-container [77]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.deployment.autodeploy [71]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.transaction.jts [163]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise.transaction.JavaEETransactionManagerSimplified
>>>>>>>>>> initDelegates
>>>>>>>>>> INFO: Using
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .transaction.jts.JavaEETransactionManagerJTSDelegate as the
>>>>>>>>>> delegate
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.connectors.work-
>>>>>>>>>> management [216]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.connectors.internal-api
>>>>>>>>>> [56]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.flashlight.framework [82]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM
>>>>>>>>>> org.glassfish.admin.mbeanserver.ConnectorStartupService
>>>>>>>>>> $ConnectorsStarterThread startConnector
>>>>>>>>>> INFO: Started JMXConnector, JMXService URL =
>>>>>>>>>> service:jmx:rmi:///jndi/rmi://192.168.1.5:8686/jmxrmi
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle com.sun.grizzly.grizzly-config [111]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM
>>>>>>>>>> com.sun.enterprise.v3.services.impl.GrizzlyProxy start
>>>>>>>>>> INFO: Listening on port 8080
>>>>>>>>>> Apr 24, 2009 12:14:53 PM
>>>>>>>>>> com.sun.enterprise.v3.services.impl.GrizzlyService
>>>>>>>>>> createNetworkProxy
>>>>>>>>>> INFO: Network listener http-listener-2 on port 8181
>>>>>>>>>> disabled per domain.xml
>>>>>>>>>> Apr 24, 2009 12:14:53 PM
>>>>>>>>>> com.sun.enterprise.v3.services.impl.GrizzlyProxy start
>>>>>>>>>> INFO: Listening on port 4848
>>>>>>>>>> Apr 24, 2009 12:14:53 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.deployment.common [73]
>>>>>>>>>> Apr 24, 2009 12:14:53 PM
>>>>>>>>>> com.sun.enterprise.v3.server.AppServerStartup run
>>>>>>>>>> INFO: GlassFish v3 startup time : Felix(1253ms) startup
>>>>>>>>>> services(693ms) total(1946ms)
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> org.glassfish.admin.mbeanserver.ConnectorStartupService
>>>>>>>>>> $BootAMXListener handleNotification
>>>>>>>>>> INFO: ConnectorStartupService.BootAMXListener: connection
>>>>>>>>>> made, booting AMX MBeans
>>>>>>>>>> Apr 24, 2009 12:14:56 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.amx-impl [19]
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: org.glassfish.admin.amx.loader.AMXStartupService
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: Got loader for AMXStartupServiceMBean:
>>>>>>>>>> org.glassfish.admin.amx.loader.AMXStartupService_at_237dabb0
>>>>>>>>>> Apr 24, 2009 12:14:56 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.security.realms [187]
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> org.glassfish.admin.amx.loader.AMXStartupService startAMX
>>>>>>>>>> INFO: AMXStartupService: loaded 117 AMX MBeans in 315 ms
>>>>>>>>>> (wall-clock time)
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> org.glassfish.admin.mbeanserver.ConnectorStartupService
>>>>>>>>>> $BootAMXListener handleNotification
>>>>>>>>>> INFO: ConnectorStartupService.BootAMXListener: connection
>>>>>>>>>> made, booting AMX MBeans
>>>>>>>>>> Apr 24, 2009 12:14:56 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.amx-core-impl [13]
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: ProxyFactory: mDomainRootObjectName =
>>>>>>>>>> v3:pp=,type=DomainRoot,name=v3
>>>>>>>>>> Apr 24, 2009 12:14:56 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.amx-j2ee-impl [21]
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/,type=SystemInfo
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED:
>>>>>>>>>> v3:pp=/,type=J2EEDomain,j2eeType=J2EEDomain,name=v3
>>>>>>>>>> Apr 24, 2009 12:14:56 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.amx-config-impl [9]
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/
>>>>>>>>>> J2EEDomain,type=J2EEServer,name=das,j2eeType=J2EEServer
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/J2EEDomain/
>>>>>>>>>> J2EEServer[das],type=JVM,j2eeType=JVM,J2EEServer=das
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/,type=domain
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain,type=system-applications
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain,type=applications
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain,type=resources
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources,type=jdbc-
>>>>>>>>>> resource,name=jdbc/__TimerPool
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources,type=jdbc-
>>>>>>>>>> resource,name=jdbc/__default
>>>>>>>>>> Apr 24, 2009 12:14:56 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources,type=jdbc-
>>>>>>>>>> connection-pool,name=__TimerPool
>>>>>>>>>> Apr 24, 2009 12:14:57 PM
>>>>>>>>>> org.glassfish.admin.amx.impl.config.ConfigBeanJMXSupport
>>>>>>>>>> <init>
>>>>>>>>>> WARNING: ConfigBeanJMXSupport (AMX): working around
>>>>>>>>>> @Configured bug for com.sun.grizzly.config.dom.ThreadPool,
>>>>>>>>>> using "ThreadPoolId" as the key attribute
>>>>>>>>>> Apr 24, 2009 12:14:57 PM OSGiModuleImpl start
>>>>>>>>>> INFO: Started bundle org.glassfish.common.amx-ext-impl [17]
>>>>>>>>>> Apr 24, 2009 12:14:57 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources/jdbc-connection-
>>>>>>>>>> pool[__TimerPool],type=property,name=databaseName Apr 24,
>>>>>>>>>> 2009 12:14:57 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources/jdbc-connection-
>>>>>>>>>> pool[__TimerPool],type=property,name=connectionAttributes
>>>>>>>>>> Apr 24, 2009 12:14:57 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources,type=jdbc-
>>>>>>>>>> connection-pool,name=DerbyPool
>>>>>>>>>> Apr 24, 2009 12:14:57 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources/jdbc-connection-
>>>>>>>>>> pool[DerbyPool],type=property,name=PortNumber Apr 24, 2009
>>>>>>>>>> 12:14:57 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources/jdbc-connection-
>>>>>>>>>> pool[DerbyPool],type=property,name=Password Apr 24, 2009
>>>>>>>>>> 12:14:57 PM
>>>>>>>>>> INFO: VALIDATED: v3:pp=/domain/resources/jdbc-connection-
>>>>>>>>>> pool[DerbyPool],type=property,name=User ^\2009-04-24 12:18:30
>>>>>>>>>> Full thread dump Java HotSpot(TM) 64-Bit Server VM
>>>>>>>>>> (1.6.0_07-b06-57 mixed mode):
>>>>>>>>>> "domain1-StderrDrainer" daemon prio=5
>>>>>>>>>> tid=0x00000001030cd800 nid=0x116d76000 runnable
>>>>>>>>>> [0x0000000116d75000..0x0000000116d75ad0]
>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>> at java.io.FileInputStream.readBytes(Native Method)
>>>>>>>>>> at java.io.FileInputStream.read(FileInputStream.java:199)
>>>>>>>>>> at java.lang.UNIXProcess
>>>>>>>>>> $DeferredCloseInputStream.read(UNIXProcess.java:227)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.fill(BufferedInputStream.java:
>>>>>>>>>> 218)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.read1(BufferedInputStream.java:
>>>>>>>>>> 258)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.read(BufferedInputStream.java:
>>>>>>>>>> 317)
>>>>>>>>>> - locked <0x000000010b113820> (a java.io.BufferedInputStream)
>>>>>>>>>> at java.io.FilterInputStream.read(FilterInputStream.java:90)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .universal
>>>>>>>>>> .process
>>>>>>>>>> .ProcessStreamDrainerWorker
>>>>>>>>>> .run(ProcessStreamDrainerWorker.java:69) at
>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>> "domain1-StdoutDrainer" daemon prio=5
>>>>>>>>>> tid=0x00000001030cd000 nid=0x116c73000 runnable
>>>>>>>>>> [0x0000000116c72000..0x0000000116c72ad0]
>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>> at java.io.FileInputStream.readBytes(Native Method)
>>>>>>>>>> at java.io.FileInputStream.read(FileInputStream.java:199)
>>>>>>>>>> at java.lang.UNIXProcess
>>>>>>>>>> $DeferredCloseInputStream.read(UNIXProcess.java:227)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.read1(BufferedInputStream.java:
>>>>>>>>>> 256)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.read(BufferedInputStream.java:
>>>>>>>>>> 317)
>>>>>>>>>> - locked <0x000000010b113a48> (a java.io.BufferedInputStream)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.fill(BufferedInputStream.java:
>>>>>>>>>> 218)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.read1(BufferedInputStream.java:
>>>>>>>>>> 258)
>>>>>>>>>> at
>>>>>>>>>> java.io.BufferedInputStream.read(BufferedInputStream.java:
>>>>>>>>>> 317)
>>>>>>>>>> - locked <0x000000010b1138f8> (a java.io.BufferedInputStream)
>>>>>>>>>> at java.io.FilterInputStream.read(FilterInputStream.java:90)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .universal
>>>>>>>>>> .process
>>>>>>>>>> .ProcessStreamDrainerWorker
>>>>>>>>>> .run(ProcessStreamDrainerWorker.java:69) at
>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>> "process reaper" daemon prio=5 tid=0x00000001030cc000
>>>>>>>>>> nid=0x116b70000 runnable
>>>>>>>>>> [0x0000000116b6f000..0x0000000116b6fad0]
>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>> at java.lang.UNIXProcess.waitForProcessExit(Native Method)
>>>>>>>>>> at java.lang.UNIXProcess.access$900(UNIXProcess.java:17)
>>>>>>>>>> at java.lang.UNIXProcess$2$1.run(UNIXProcess.java:86)
>>>>>>>>>> "Low Memory Detector" daemon prio=5 tid=0x0000000103044800
>>>>>>>>>> nid=0x116105000 runnable
>>>>>>>>>> [0x0000000000000000..0x0000000000000000]
>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>> "CompilerThread1" daemon prio=9 tid=0x0000000103043000
>>>>>>>>>> nid=0x116002000 waiting on condition
>>>>>>>>>> [0x0000000000000000..0x00000001160003e0]
>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>> "CompilerThread0" daemon prio=9 tid=0x0000000103041800
>>>>>>>>>> nid=0x115eff000 waiting on condition
>>>>>>>>>> [0x0000000000000000..0x0000000115efd3e0]
>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>> "Signal Dispatcher" daemon prio=9 tid=0x0000000103041000
>>>>>>>>>> nid=0x115dfc000 waiting on condition
>>>>>>>>>> [0x0000000000000000..0x0000000000000000]
>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>> "Finalizer" daemon prio=8 tid=0x0000000103029800
>>>>>>>>>> nid=0x115ce2000 in Object.wait() [0x0000000115ce1000..0x00
>>>>>>>>>> 00000115ce1ad0]
>>>>>>>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>> at java.lang.Object.wait(Native Method)
>>>>>>>>>> - waiting on <0x000000010cafb828> (a
>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:
>>>>>>>>>> 116)
>>>>>>>>>> - locked <0x000000010cafb828> (a
>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:
>>>>>>>>>> 132)
>>>>>>>>>> at java.lang.ref.Finalizer
>>>>>>>>>> $FinalizerThread.run(Finalizer.java:159)
>>>>>>>>>> "Reference Handler" daemon prio=10 tid=0x0000000103028800
>>>>>>>>>> nid=0x115bd9000 in Object.wait()
>>>>>>>>>> [0x0000000115bd8000..0x0000000115bd8ad0]
>>>>>>>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>> at java.lang.Object.wait(Native Method)
>>>>>>>>>> - waiting on <0x000000010cafb908> (a java.lang.ref.Reference
>>>>>>>>>> $Lock)
>>>>>>>>>> at java.lang.Object.wait(Object.java:485)
>>>>>>>>>> at java.lang.ref.Reference
>>>>>>>>>> $ReferenceHandler.run(Reference.java:116)
>>>>>>>>>> - locked <0x000000010cafb908> (a java.lang.ref.Reference
>>>>>>>>>> $Lock)
>>>>>>>>>> "main" prio=5 tid=0x0000000103001000 nid=0x103901000 in
>>>>>>>>>> Object.wait() [0x0000000103900000..0x0000000103900c70]
>>>>>>>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>> at java.lang.Object.wait(Native Method)
>>>>>>>>>> - waiting on <0x000000010b110250> (a java.lang.UNIXProcess)
>>>>>>>>>> at java.lang.Object.wait(Object.java:485)
>>>>>>>>>> at java.lang.UNIXProcess.waitFor(UNIXProcess.java:115)
>>>>>>>>>> - locked <0x000000010b110250> (a java.lang.UNIXProcess)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise.admin.launcher.GFLauncher.wait(GFLauncher.java:
>>>>>>>>>> 298)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .admin.launcher.GFLauncher.launchInstance(GFLauncher.java:
>>>>>>>>>> 248) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .admin
>>>>>>>>>> .launcher
>>>>>>>>>> .GFDomainLauncher.internalLaunch(GFDomainLauncher.java:
>>>>>>>>>> 47) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .admin.launcher.GFLauncher.launch(GFLauncher.java:68)
>>>>>>>>>> - locked <0x000000010cb499e0> (a
>>>>>>>>>> com.sun.enterprise.admin.launcher.GFDomainLauncher)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .admin
>>>>>>>>>> .cli
>>>>>>>>>> .StartDomainCommand
>>>>>>>>>> .runCommandNotEmbedded(StartDomainCommand.java:99) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .admin
>>>>>>>>>> .cli.StartDomainCommand.runCommand(StartDomainCommand.java:
>>>>>>>>>> 46) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .cli.framework.CLIMain.invokeCommand(CLIMain.java:160)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise.admin.cli.AsadminMain.local(AsadminMain.java:150)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun.enterprise.admin.cli.AsadminMain.main(AsadminMain.java:
>>>>>>>>>> 76)
>>>>>>>>>> "VM Thread" prio=9 tid=0x0000000103020800 nid=0x115ad6000
>>>>>>>>>> runnable
>>>>>>>>>> "VM Periodic Task Thread" prio=10 tid=0x0000000103046000
>>>>>>>>>> nid=0x116208000 waiting on condition
>>>>>>>>>> "Exception Catcher Thread" prio=10 tid=0x0000000103002000
>>>>>>>>>> nid=0x103a04000 runnable
>>>>>>>>>> 2009-04-24 12:18:30
>>>>>>>>>> Full thread dump Java HotSpot(TM) 64-Bit Server VM
>>>>>>>>>> (1.6.0_07-b06-57 mixed mode):
>>>>>>>>>> "AMXConfigLoader.AMXConfigLoaderThread" daemon prio=5
>>>>>>>>>> tid=0x0000000103321000 nid=0x13bc2b000 waiting on condition
>>>>>>>>>> [0x000000013bc2a000..0x000000013bc2aad0]
>>>>>>>>>> java.lang.Thread.State: WAITING (parking)
>>>>>>>>>> at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>> - parking to wait for <0x0000000116623cf0> (a
>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>> $ConditionObject)
>>>>>>>>>> at
>>>>>>>>>> java
>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:158)
>>>>>>>>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>> 1925) JNI global references: 657
>>>>>>>>>> Heap
>>>>>>>>>> def new generation total 2304K, used 298K
>>>>>>>>>> [0x000000010aed0000, 0x000000010b160000, 0x000000010cad0000)
>>>>>>>>>> eden space 1984K, 2% used at
>>>>>>>>>> java
>>>>>>>>>> .util
>>>>>>>>>> .concurrent
>>>>>>>>>> .LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .mbeanserver
>>>>>>>>>> .PendingConfigBeansNew.take(PendingConfigBeansNew.java:
>>>>>>>>>> 115) at
>>>>>>>>>> org.glassfish.admin.amx.impl.config.AMXConfigLoader
>>>>>>>>>> $AMXConfigLoaderThread.doRun(AMXConfigLoader.java:482)
>>>>>>>>>> at org.glassfish.admin.amx.impl.config.AMXConfigLoader
>>>>>>>>>> $AMXConfigLoaderThread.run(AMXConfigLoader.java:448)
>>>>>>>>>> "ComplianceMonitor.ValidatorThread" daemon prio=5
>>>>>>>>>> tid=0x0000000103317800 nid=0x13bb28000 waiting for monitor
>>>>>>>>>> entry [0x000000013bb26000..0x000000013bb27ad0]
>>>>>>>>>> java.lang.Thread.State: BLOCKED (on object monitor)
>>>>>>>>>> at java.util.logging.LogManager.getLogger(LogManager.java:
>>>>>>>>>> 550)
>>>>>>>>>> - waiting to lock <0x000000011599a0b8> (a
>>>>>>>>>> java.util.logging.LogManager)
>>>>>>>>>> at java.util.logging.Logger.getLogger(Logger.java:275)
>>>>>>>>>> - locked <0x000000012b1c11b0> (a java.lang.Class for
>>>>>>>>>> java.util.logging.Logger)
>>>>>>>>>> at
>>>>>>>>>> com.sun.jmx.trace.TraceManager.getLogger(TraceManager.java:
>>>>>>>>>> 166)
>>>>>>>>>> at
>>>>>>>>>> com.sun.jmx.trace.TraceManager.isSelected(TraceManager.java:
>>>>>>>>>> 197)
>>>>>>>>>> at com.sun.jmx.trace.Trace.isSelected(Trace.java:84)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .isTraceOn(DefaultMBeanServerInterceptor.java:1832) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .getAttribute(DefaultMBeanServerInterceptor.java:657)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .mbeanserver
>>>>>>>>>> .JmxMBeanServer.getAttribute(JmxMBeanServer.java:638)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .util
>>>>>>>>>> .jmx.MBeanProxyHandler.getAttribute(MBeanProxyHandler.java:
>>>>>>>>>> 251) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .util
>>>>>>>>>> .jmx
>>>>>>>>>> .MBeanProxyHandler
>>>>>>>>>> .getAttributeNoThrow(MBeanProxyHandler.java:263) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core
>>>>>>>>>> .proxy.AMXProxyHandler.getChildren(AMXProxyHandler.java:
>>>>>>>>>> 792) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core
>>>>>>>>>> .proxy.AMXProxyHandler.childrenSet(AMXProxyHandler.java:
>>>>>>>>>> 810) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core
>>>>>>>>>> .proxy
>>>>>>>>>> .AMXProxyHandler.handleSpecialMethod(AMXProxyHandler.java:
>>>>>>>>>> 421) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core.proxy.AMXProxyHandler._invoke(AMXProxyHandler.java:
>>>>>>>>>> 594) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.core.proxy.AMXProxyHandler.invoke(AMXProxyHandler.java:
>>>>>>>>>> 552) at $Proxy66.childrenSet(Unknown Source)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listChildren(PathnamesImpl.java:
>>>>>>>>>> 226) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listChildren(PathnamesImpl.java:
>>>>>>>>>> 234) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listChildren(PathnamesImpl.java:
>>>>>>>>>> 245) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listObjectNames(PathnamesImpl.java:
>>>>>>>>>> 261) at
>>>>>>>>>> sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
>>>>>>>>>> at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.impl.mbean.AMXImplBase.invoke(AMXImplBase.java:
>>>>>>>>>> 1082) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .invoke(DefaultMBeanServerInterceptor.java:836) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:
>>>>>>>>>> 761)
>>>>>>>>>> at
>>>>>>>>>> javax
>>>>>>>>>> .management
>>>>>>>>>> .MBeanServerInvocationHandler
>>>>>>>>>> .invoke(MBeanServerInvocationHandler.java:288) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .util.jmx.MBeanProxyHandler.invoke(MBeanProxyHandler.java:
>>>>>>>>>> 467) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core.proxy.AMXProxyHandler._invoke(AMXProxyHandler.java:
>>>>>>>>>> 605) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.core.proxy.AMXProxyHandler.invoke(AMXProxyHandler.java:
>>>>>>>>>> 552) at $Proxy69.listObjectNames(Unknown Source)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.core.AMXValidator.validate(AMXValidator.java:318)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.core.AMXValidator.validate(AMXValidator.java:331)
>>>>>>>>>> at org.glassfish.admin.amx.impl.mbean.ComplianceMonitor
>>>>>>>>>> $ValidatorThread.doRun(ComplianceMonitor.java:134) at
>>>>>>>>>> org.glassfish.admin.amx.impl.mbean.ComplianceMonitor
>>>>>>>>>> $ValidatorThread.run(ComplianceMonitor.java:118) "pool-1-
>>>>>>>>>> thread-6" prio=5 tid=0x00000001032f3800 nid=0x13c168000
>>>>>>>>>> waiting on condition [0x000000013c167000..0x000000013c167ad0]
>>>>>>>>>> java.lang.Thread.State: WAITING (parking)
>>>>>>>>>> at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>> - parking to wait for <0x0000000116ac5278> (a
>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>> $ConditionObject)
>>>>>>>>>> at
>>>>>>>>>> java
>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:158)
>>>>>>>>>> at java.util.con [0x000000010aed0000, 0x000000010aedb240,
>>>>>>>>>> 0x000000010b0c0000)
>>>>>>>>>> from space 320K, 79% used [0x000000010b110000,
>>>>>>>>>> 0x000000010b14f690, 0x000000010b160000)
>>>>>>>>>> to space 320K, 0% used [0x000000010b0c0000,
>>>>>>>>>> 0x000000010b0c0000, 0x000000010b110000)
>>>>>>>>>> tenured generation total 5312K, used 735K
>>>>>>>>>> [0x000000010cad0000, 0x000000010d000000, 0x00000001102d0000)
>>>>>>>>>>> the space 5312K, 13% used [0x000000010cad0000,
>>>>>>>>>>> 0x000000010cb87fc0, 0x000000010cb88000, 0x000000010d000000)
>>>>>>>>>>> compacting perm gen total 21248K, used 8712K
>>>>>>>>>>> [0x00000001102d0000, 0x0000000111790000, 0x00000001156d0000)
>>>>>>>>>>> thecurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1925) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
>>>>>>>>>>> at org.jvnet.hk2.config.Transactions$Notifier
>>>>>>>>>>> $1.run(Transactions.java:142)
>>>>>>>>>>> at java.util.concurrent.Executors
>>>>>>>>>>> $RunnableAdapter.call(Executors.java:441)
>>>>>>>>>>> at java.util.concurrent.FutureTask
>>>>>>>>>>> $Sync.innerRun(FutureTask.java:303)
>>>>>>>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>>>>>>>>>> at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.runTask(ThreadPoolExecutor.java:885) at
>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:907) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> "AMXConfigLoader.AMXConfigLoaderThread" daemon prio=5
>>>>>>>>>>> tid=0x00000001032f3000 nid=0x13c065000 waiting on
>>>>>>>>>>> condition [0x000000013c064000..0x000000013c064ad0]
>>>>>>>>>>> java.lang.Thread.State: WAITING (parking)
>>>>>>>>>>> at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> - parking to wait for <0x0000000116641c68> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> at
>>>>>>>>>>> java
>>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:
>>>>>>>>>>> 158)
>>>>>>>>>>> at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1925) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .mbeanserver
>>>>>>>>>>> .PendingConfigBeans.take(PendingConfigBeans.java:117)
>>>>>>>>>>> at org.glassfish.admin.amx.config.AMXConfigLoader
>>>>>>>>>>> $AMXConfigLoaderThread.doRun(AMXConfigLoader.java:521)
>>>>>>>>>>> at org.glassfish.admin.amx.config.AMXConfigLoader
>>>>>>>>>>> $AMXConfigLoaderThread.run(AMXConfigLoader.java:488) "JMX
>>>>>>>>>>> server connection timeout 51" daemon prio=5
>>>>>>>>>>> tid=0x00000001032d4000 nid=0x13ba25000 in Object.wait()
>>>>>>>>>>> [0x000000013ba24000..0x000000013ba24ad0]
>>>>>>>>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> at java.lang.Object.wait(Native Method)
>>>>>>>>>>> - waiting on <0x0000000116ac55f0> (a [I)
>>>>>>>>>>> at java.lang.Object.wait(Object.java:485)
>>>>>>>>>>> at com.sun.jmx.remote.internal.ServerCommunicatorAdmin
>>>>>>>>>>> $Timeout.run(ServerCommunicatorAdmin.java:132) -
>>>>>>>>>>> locked <0x0000000116ac55f0> (a [I)
>>>>>>>>>>> at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> "RMI TCP Connection(4)-192.168.1.5" daemon prio=5
>>>>>>>>>>> tid=0x00000001032d3800 nid=0x13b922000 waiting for monitor
>>>>>>>>>>> entry [0x000000013b91d000..0x000000013b921ad0]
>>>>>>>>>>> java.lang.Thread.State: BLOCKED (on object monitor)
>>>>>>>>>>> at java.util.logging.Logger.getLogger(Logger.java:274)
>>>>>>>>>>> - waiting to lock <0x000000012b1c11b0> (a java.lang.Class
>>>>>>>>>>> for java.util.logging.Logger)
>>>>>>>>>>> space 21248K, 41% used [0x00000001102d0000,
>>>>>>>>>>> 0x0000000110b520b8, 0x0000000110b52200, 0x0000000111790000)
>>>>>>>>>>> No shared spaces configured.
>>>>>>>>>>> at java.util.logging.LogManager.addLogger(LogManager.java:
>>>>>>>>>>> 399)
>>>>>>>>>>> - locked <0x000000011599a0b8> (a
>>>>>>>>>>> java.util.logging.LogManager)
>>>>>>>>>>> at com.sun.logging.LogDomains.getLogger(LogDomains.java:331)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .appserv.security.AppservRealm.<clinit>(AppservRealm.java:
>>>>>>>>>>> 64)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect.NativeConstructorAccessorImpl.newInstance0(Native
>>>>>>>>>>> Method)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .NativeConstructorAccessorImpl
>>>>>>>>>>> .newInstance(NativeConstructorAccessorImpl.java:39) at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .DelegatingConstructorAccessorImpl
>>>>>>>>>>> .newInstance(DelegatingConstructorAccessorImpl.java:
>>>>>>>>>>> 27) at
>>>>>>>>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:
>>>>>>>>>>> 513)
>>>>>>>>>>> at java.lang.Class.newInstance0(Class.java:355)
>>>>>>>>>>> at java.lang.Class.newInstance(Class.java:308)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .enterprise
>>>>>>>>>>> .security.auth.realm.Realm.doInstantiate(Realm.java:243)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .enterprise
>>>>>>>>>>> .security.auth.realm.Realm.instantiate(Realm.java:165)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx.impl.ext.RealmsMgrImpl.loadRealms(RealmsMgrImpl.java:
>>>>>>>>>>> 111) - locked <0x000000010b9c05c8> (a
>>>>>>>>>>> org.glassfish.admin.amx.impl.ext.RealmsMgrImpl)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx.impl.ext.RealmsMgrImpl.getRealm(RealmsMgrImpl.java:
>>>>>>>>>>> 166) at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx
>>>>>>>>>>> .impl.ext.RealmsMgrImpl.getUserNames(RealmsMgrImpl.java:
>>>>>>>>>>> 252) at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx
>>>>>>>>>>> .impl
>>>>>>>>>>> .ext.RealmsMgrImpl.getAnonymousLogin(RealmsMgrImpl.java:
>>>>>>>>>>> 360) at
>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .NativeMethodAccessorImpl
>>>>>>>>>>> .invoke(NativeMethodAccessorImpl.java:39) at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx
>>>>>>>>>>> .impl
>>>>>>>>>>> .mbean.AMXImplBase.getAttributeByMethod(AMXImplBase.java:
>>>>>>>>>>> 588) at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx
>>>>>>>>>>> .impl
>>>>>>>>>>> .mbean.AMXImplBase.getAttributeInternal(AMXImplBase.java:
>>>>>>>>>>> 505) at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx.impl.mbean.AMXImplBase.getAttribute(AMXImplBase.java:
>>>>>>>>>>> 460) at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .jmx
>>>>>>>>>>> .interceptor
>>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>>> .getAttribute(DefaultMBeanServerInterceptor.java:666)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .jmx
>>>>>>>>>>> .mbeanserver
>>>>>>>>>>> .JmxMBeanServer.getAttribute(JmxMBeanServer.java:638)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin
>>>>>>>>>>> .amx
>>>>>>>>>>> .util
>>>>>>>>>>> .jmx.MBeanProxyHandler.getAttribute(MBeanProxyHandler.java:
>>>>>>>>>>> 251) at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin.amx.core.AMXValidator._validate(AMXValidator.java:
>>>>>>>>>>> 199)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin.amx.core.AMXValidator.validate(AMXValidator.java:322)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin.amx.impl.mbean.ToolsImpl.validate(ToolsImpl.java:157)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin.amx.impl.mbean.ToolsImpl.validate(ToolsImpl.java:169)
>>>>>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>>>>>>> Method)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .NativeMethodAccessorImpl
>>>>>>>>>>> .invoke(NativeMethodAccessorImpl.java:39) at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>> at
>>>>>>>>>>> org
>>>>>>>>>>> .glassfish
>>>>>>>>>>> .admin.amx.impl.mbean.AMXImplBase.invoke(AMXImplBase.java:
>>>>>>>>>>> 1082) at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .jmx
>>>>>>>>>>> .interceptor
>>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>>> .invoke(DefaultMBeanServerInterceptor.java:836) at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:
>>>>>>>>>>> 761)
>>>>>>>>>>> at
>>>>>>>>>>> javax
>>>>>>>>>>> .management
>>>>>>>>>>> .remote
>>>>>>>>>>> .rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:
>>>>>>>>>>> 1426) at
>>>>>>>>>>> javax.management.remote.rmi.RMIConnectionImpl.access
>>>>>>>>>>> $200(RMIConnectionImpl.java:72) at
>>>>>>>>>>> javax.management.remote.rmi.RMIConnectionImpl
>>>>>>>>>>> $PrivilegedOperation.run(RMIConnectionImpl.java:1264)
>>>>>>>>>>> at
>>>>>>>>>>> javax
>>>>>>>>>>> .management
>>>>>>>>>>> .remote
>>>>>>>>>>> .rmi
>>>>>>>>>>> .RMIConnectionImpl
>>>>>>>>>>> .doPrivilegedOperation(RMIConnectionImpl.java:1359) at
>>>>>>>>>>> javax
>>>>>>>>>>> .management
>>>>>>>>>>> .remote
>>>>>>>>>>> .rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:
>>>>>>>>>>> 788) at
>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .NativeMethodAccessorImpl
>>>>>>>>>>> .invoke(NativeMethodAccessorImpl.java:39) at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .rmi
>>>>>>>>>>> .server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
>>>>>>>>>>> at sun.rmi.transport.Transport$1.run(Transport.java:159)
>>>>>>>>>>> at java.security.AccessController.doPrivileged(Native
>>>>>>>>>>> Method)
>>>>>>>>>>> at sun.rmi.transport.Transport.serviceCall(Transport.java:
>>>>>>>>>>> 155)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .rmi
>>>>>>>>>>> .transport
>>>>>>>>>>> .tcp.TCPTransport.handleMessages(TCPTransport.java:535)
>>>>>>>>>>> at sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>>> $ConnectionHandler.run0(TCPTransport.java:790) at
>>>>>>>>>>> sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>>> $ConnectionHandler.run(TCPTransport.java:649) at
>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.runTask(ThreadPoolExecutor.java:885) at
>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:907) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> "RMI TCP Connection(idle)" daemon prio=5
>>>>>>>>>>> tid=0x00000001032d2800 nid=0x13b81f000 waiting on
>>>>>>>>>>> condition [0x000000013b81e000..0x000000013b81ead0]
>>>>>>>>>>> java.lang.Thread.State: TIMED_WAITING (parking)
>>>>>>>>>>> at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> - parking to wait for <0x00000001168cef70> (a
>>>>>>>>>>> java.util.concurrent.SynchronousQueue$TransferStack)
>>>>>>>>>>> at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent.locks.LockSupport.parkNanos(LockSupport.java:
>>>>>>>>>>> 198)
>>>>>>>>>>> at java.util.concurrent.SynchronousQueue
>>>>>>>>>>> $TransferStack.awaitFulfill(SynchronousQueue.java:424)
>>>>>>>>>>> at java.util.concurrent.SynchronousQueue
>>>>>>>>>>> $TransferStack.transfer(SynchronousQueue.java:323) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent.SynchronousQueue.poll(SynchronousQueue.java:874)
>>>>>>>>>>> at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:
>>>>>>>>>>> 944) at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:906) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> "GrizzlySelectorRunner-TCP" prio=5 tid=0x00000001032c0800
>>>>>>>>>>> nid=0x13b413000 runnable
>>>>>>>>>>> [0x000000013b412000..0x000000013b412ad0]
>>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>>> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
>>>>>>>>>>> at
>>>>>>>>>>> sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:
>>>>>>>>>>> 136)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .nio
>>>>>>>>>>> .ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
>>>>>>>>>>> at
>>>>>>>>>>> sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:
>>>>>>>>>>> 69)
>>>>>>>>>>> - locked <0x0000000116ac8878> (a sun.nio.ch.Util$1)
>>>>>>>>>>> - locked <0x0000000116ac8890> (a java.util.Collections
>>>>>>>>>>> $UnmodifiableSet)
>>>>>>>>>>> - locked <0x0000000116ac8800> (a
>>>>>>>>>>> sun.nio.ch.KQueueSelectorImpl)
>>>>>>>>>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:
>>>>>>>>>>> 489)
>>>>>>>>>>> at com.sun.grizzly.Controller.doSelect(Controller.java:328)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .SelectorHandlerRunner.run(SelectorHandlerRunner.java:90)
>>>>>>>>>>> at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> "GrizzlySelectorRunner-TCP" prio=5 tid=0x00000001032c0000
>>>>>>>>>>> nid=0x13b310000 runnable
>>>>>>>>>>> [0x000000013b30f000..0x000000013b30fad0]
>>>>>>>>>>> java.lang.Thread.State: RUNNABLE
>>>>>>>>>>> at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
>>>>>>>>>>> at
>>>>>>>>>>> sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:
>>>>>>>>>>> 136)
>>>>>>>>>>> at
>>>>>>>>>>> sun
>>>>>>>>>>> .nio
>>>>>>>>>>> .ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69)
>>>>>>>>>>> at
>>>>>>>>>>> sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:
>>>>>>>>>>> 69)
>>>>>>>>>>> - locked <0x0000000116ac8950> (a sun.nio.ch.Util$1)
>>>>>>>>>>> - locked <0x0000000116ac8968> (a java.util.Collections
>>>>>>>>>>> $UnmodifiableSet)
>>>>>>>>>>> - locked <0x0000000116ac88d8> (a
>>>>>>>>>>> sun.nio.ch.KQueueSelectorImpl)
>>>>>>>>>>> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly.TCPSelectorHandler.select(TCPSelectorHandler.java:
>>>>>>>>>>> 489)
>>>>>>>>>>> at com.sun.grizzly.Controller.doSelect(Controller.java:328)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .SelectorHandlerRunner.run(SelectorHandlerRunner.java:90)
>>>>>>>>>>> at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> "Thread-8" prio=5 tid=0x00000001032a8000 nid=0x13aa81000
>>>>>>>>>>> in Object.wait() [0x000000013aa80000..0x000000013aa80ad0]
>>>>>>>>>>> java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>>>>>>>>> at java.lang.Object.wait(Native Method)
>>>>>>>>>>> - waiting on <0x0000000116ab2228> (a
>>>>>>>>>>> java.util.concurrent.atomic.AtomicInteger)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .Controller.waitUntilSeletorHandlersStop(Controller.java:
>>>>>>>>>>> 1221) - locked <0x0000000116ab2228> (a
>>>>>>>>>>> java.util.concurrent.atomic.AtomicInteger)
>>>>>>>>>>> at com.sun.grizzly.Controller.start(Controller.java:968)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .http.SelectorThread.startListener(SelectorThread.java:1180)
>>>>>>>>>>> - locked <0x0000000116ab2240> (a java.lang.Object)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun.grizzly.http.SelectorThread.run(SelectorThread.java:
>>>>>>>>>>> 1031)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .http.SelectorThread.startEndpoint(SelectorThread.java:1107)
>>>>>>>>>>> at com.sun.enterprise.v3.services.impl.GrizzlyProxy
>>>>>>>>>>> $1.run(GrizzlyProxy.java:211) "Thread-7" prio=5
>>>>>>>>>>> tid=0x00000001032a4800 nid=0x13a46f000 in Object.wait()
>>>>>>>>>>> [0x000000013a46e000..0x000000013a46ead0]
>>>>>>>>>>> java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>>>>>>>>> at java.lang.Object.wait(Native Method)
>>>>>>>>>>> - waiting on <0x0000000116ab2500> (a
>>>>>>>>>>> java.util.concurrent.atomic.AtomicInteger)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .Controller.waitUntilSeletorHandlersStop(Controller.java:
>>>>>>>>>>> 1221) - locked <0x0000000116ab2500> (a
>>>>>>>>>>> java.util.concurrent.atomic.AtomicInteger)
>>>>>>>>>>> at com.sun.grizzly.Controller.start(Controller.java:968)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .http.SelectorThread.startListener(SelectorThread.java:1180)
>>>>>>>>>>> - locked <0x0000000116ab2518> (a java.lang.Object)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun.grizzly.http.SelectorThread.run(SelectorThread.java:
>>>>>>>>>>> 1031)
>>>>>>>>>>> at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .grizzly
>>>>>>>>>>> .http.SelectorThread.startEndpoint(SelectorThread.java:1107)
>>>>>>>>>>> at com.sun.enterprise.v3.services.impl.GrizzlyProxy
>>>>>>>>>>> $1.run(GrizzlyProxy.java:211) "RMI RenewClean-
>>>>>>>>>>> [192.168.1.5:56351]" daemon prio=5 tid=0x0000000103275800
>>>>>>>>>>> nid=0x13b10a000 in Object.wait()
>>>>>>>>>>> [0x000000013b109000..0x000000013b109ad0]
>>>>>>>>>> *java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>> *
>>>>>> *< /blockquote>*
>>>>>>>>>>> * - waiting on <0x000000011688b250> (a
>>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011688b250> (a
>>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.rmi.transport.DGCClient$EndpointEntry
>>>>>>>>>>> $RenewCleanThread.run(DGCClient.java:516) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"RMI Scheduler(0)" daemon prio=5 tid=0x000000010326c000
>>>>>>>>>>> nid=0x13b007000 waiting on condition
>>>>>>>>>>> [0x000000013b006000..0x000000013b006ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: TIMED_WAITING (parking)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - parking to wait for <0x000000011688b3b8> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent.locks.LockSupport.parkNanos(LockSupport.java:
>>>>>>>>>>> 198)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $
>>>>>>>>>>> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1963) at
>>>>>>>>>>> java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.ScheduledThreadPoolExecutor
>>>>>>>>>>> $DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:
>>>>>>>>>>> 582) at
>>>>>>>>>>> java.util.concurrent.ScheduledThreadPoolExecutor
>>>>>>>>>>> $DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:
>>>>>>>>>>> 575) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:
>>>>>>>>>>> 946) at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:906) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"GC Daemon" daemon prio=2 tid=0x0000000103257800
>>>>>>>>>>> nid=0x13a97e000 in Object.wait()
>>>>>>>>>>> [0x000000013a97d000..0x000000013a97dad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x000000011688da78> (a sun.misc.GC
>>>>>>>>>>> $LatencyLock)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.GC$Daemon.run(GC.java:100)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011688da78> (a sun.misc.GC$LatencyLock)
>>>>>>>>>>> *
>>>>>>>>>>> *"RMI Reaper" prio=5 tid=0x0000000103253800
>>>>>>>>>>> nid=0x13a87b000 in Object.wait()
>>>>>>>>>>> [0x000000013a87a000..0x000000013a87aad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x000000011688db30> (a
>>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011688db30> (a
>>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.rmi.transport.ObjectTable
>>>>>>>>>>> $Reaper.run(ObjectTable.java:333)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"RMI TCP Accept-0" daemon prio=5 tid=0x0000000103252000
>>>>>>>>>>> nid=0x13a778000 runnable
>>>>>>>>>>> [0x000000013a777000..0x000000013a777ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: RUNNABLE
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.PlainSocketImpl.socketAccept(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:
>>>>>>>>>>> 384)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011688dc38> (a java.net.SocksSocketImpl)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.ServerSocket.implAccept(ServerSocket.java:453)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.ServerSocket.accept(ServerSocket.java:421)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>>> $AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
>>>>>>>>>>> at sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>>> $AcceptLoop.run(TCPTransport.java:341)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"RMI TCP Accept-8686" daemon prio=5
>>>>>>>>>>> tid=0x0000000103243000 nid=0x13ae01000 runnable
>>>>>>>>>>> [0x000000013ae00000..0x000000013ae00ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: RUNNABLE
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.PlainSocketImpl.socketAccept(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:
>>>>>>>>>>> 384)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011688dee8> (a java.net.SocksSocketImpl)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.ServerSocket.implAccept(ServerSocket.java:453)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.ServerSocket.accept(ServerSocket.java:421)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>>> $AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
>>>>>>>>>>> at sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>>> $AcceptLoop.run(TCPTransport.java:341)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"transaction-manager" daemon prio=5
>>>>>>>>>>> tid=0x000000010323e800 nid=0x13acfe000 in Object.wait()
>>>>>>>>>>> [0x000000013acfd000..0x000000013acfdad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x000000011688e190> (a java.util.TaskQueue)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Object.java:485)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.TimerThread.mainLoop(Timer.java:483)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011688e190> (a java.util.TaskQueue)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.TimerThread.run(Timer.java:462)
>>>>>>>>>>> *
>>>>>>>>>>> *"AutoDeployer" daemon prio=5 tid=0x000000010323e000
>>>>>>>>>>> nid=0x13ab9b000 in Object.wait()
>>>>>>>>>>> [0x000000013ab9a000..0x000000013ab9aad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x000000011688e268> (a java.util.TaskQueue)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.TimerThread.mainLoop(Timer.java:509)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011688e268> (a java.util.TaskQueue)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.TimerThread.run(Timer.java:462)
>>>>>>>>>>> *
>>>>>>>>>>> *"DynamicReloader" daemon prio=5 tid=0x0000000103201000
>>>>>>>>>>> nid=0x13a675000 in Object.wait()
>>>>>>>>>>> [0x000000013a674000..0x000000013a674ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x00000001167c0998> (a java.util.TaskQueue)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.TimerThread.mainLoop(Timer.java:509)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x00000001167c0998> (a java.util.TaskQueue)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.TimerThread.run(Timer.java:462)
>>>>>>>>>>> *
>>>>>>>>>>> *"pool-1-thread-5" prio=5 tid=0x00000001031fb800
>>>>>>>>>>> nid=0x13a572000 waiting on condition
>>>>>>>>>>> [0x000000013a571000..0x000000013a571ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (parking)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - parking to wait for <0x00000001167c0aa8> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java
>>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:
>>>>>>>>>>> 158)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1925) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.jvnet.hk2.config.Transactions$Notifier
>>>>>>>>>>> $1.run(Transactions.java:142)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.Executors
>>>>>>>>>>> $RunnableAdapter.call(Executors.java:441)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask
>>>>>>>>>>> $Sync.innerRun(FutureTask.java:303)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask.run(FutureTask.java:
>>>>>>>>>>> 138)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.runTask(ThreadPoolExecutor.java:885) at
>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:907) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"Thread-1" prio=5 tid=0x0000000103190800 nid=0x13a269000
>>>>>>>>>>> waiting on condition
>>>>>>>>>>> [0x000000013a268000..0x000000013a268ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (parking)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - parking to wait for <0x0000000116737908> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java
>>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:
>>>>>>>>>>> 158)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1925) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> com
>>>>>>>>>>> .sun
>>>>>>>>>>> .enterprise
>>>>>>>>>>> .server.logging.GFFileHandler.log(GFFileHandler.java:498)
>>>>>>>>>>> *
>>>>>>>>>>> * at com.sun.enterprise.server.logging.GFFileHandler
>>>>>>>>>>> $3.run(GFFileHandler.java:246) "pool-2-thread-1" daemon
>>>>>>>>>>> prio=5 tid=0x000000010318f800 nid=0x13a166000 waiting on
>>>>>>>>>>> condition [0x000000013a165000..0x000000013a165ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: TIMED_WAITING (parking)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - parking to wait for <0x00000001166d92d8> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent.locks.LockSupport.parkNanos(LockSupport.java:
>>>>>>>>>>> 198)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $
>>>>>>>>>>> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1963) at
>>>>>>>>>>> java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.ScheduledThreadPoolExecutor
>>>>>>>>>>> $DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:
>>>>>>>>>>> 582) at
>>>>>>>>>>> java.util.concurrent.ScheduledThreadPoolExecutor
>>>>>>>>>>> $DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:
>>>>>>>>>>> 575) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:
>>>>>>>>>>> 946) at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:906) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"GlassFish Kernel Main Thread" prio=5
>>>>>>>>>>> tid=0x0000000103185000 nid=0x13a063000 in Object.wait()
>>>>>>>>>>> [0x000000013a062000..0x000000013a062ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x00000001166d93c8> (a
>>>>>>>>>>> com.sun.enterprise.v3.server.AppServerStartup$1)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Object.java:485)
>>>>>>>>>>> *
>>>>>>>>>>> * at com.sun.enterprise.v3.server.AppServerStartup
>>>>>>>>>>> $1.run(AppServerStartup.java:130) - locked
>>>>>>>>>>> <0x00000001166d93c8> (a
>>>>>>>>>>> com.sun.enterprise.v3.server.AppServerStartup$1)
>>>>>>>>>>> *
>>>>>>>>>>> *"pool-1-thread-3" prio=5 tid=0x0000000103161800
>>>>>>>>>>> nid=0x139d94000 waiting on condition
>>>>>>>>>>> [0x0000000139d93000..0x0000000139d93ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (parking)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - parking to wait for <0x0000000116ebe978> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java
>>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:
>>>>>>>>>>> 158)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1925) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.jvnet.hk2.config.Transactions$Notifier
>>>>>>>>>>> $1.run(Transactions.java:142)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.Executors
>>>>>>>>>>> $RunnableAdapter.call(Executors.java:441)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask
>>>>>>>>>>> $Sync.innerRun(FutureTask.java:303)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask.run(FutureTask.java:
>>>>>>>>>>> 138)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.runTask(ThreadPoolExecutor.java:885) at
>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:907) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"pool-1-thread-2" prio=5 tid=0x000000010315e000
>>>>>>>>>>> nid=0x139c3c000 waiting on condition
>>>>>>>>>>> [0x0000000139c3b000..0x0000000139c3bad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (parking)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - parking to wait for <0x00000001165dd240> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java
>>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:
>>>>>>>>>>> 158)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1925) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.jvnet.hk2.config.Transactions$Notifier
>>>>>>>>>>> $1.run(Transactions.java:142)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.Executors
>>>>>>>>>>> $RunnableAdapter.call(Executors.java:441)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask
>>>>>>>>>>> $Sync.innerRun(FutureTask.java:303)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask.run(FutureTask.java:
>>>>>>>>>>> 138)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.runTask(ThreadPoolExecutor.java:885) at
>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:907) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"pool-1-thread-1" prio=5 tid=0x000000010315d000
>>>>>>>>>>> nid=0x139b39000 waiting on condition
>>>>>>>>>>> [0x0000000139b38000..0x0000000139b38ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (parking)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.misc.Unsafe.park(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - parking to wait for <0x00000001165dd498> (a
>>>>>>>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> java
>>>>>>>>>>> .util.concurrent.locks.LockSupport.park(LockSupport.java:
>>>>>>>>>>> 158)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.locks.AbstractQueuedSynchronizer
>>>>>>>>>>> $ConditionObject.await(AbstractQueuedSynchronizer.java:
>>>>>>>>>>> 1925) at
>>>>>>>>>>> java
>>>>>>>>>>> .util
>>>>>>>>>>> .concurrent
>>>>>>>>>>> .ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.jvnet.hk2.config.Transactions$Notifier
>>>>>>>>>>> $1.run(Transactions.java:142)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.Executors
>>>>>>>>>>> $RunnableAdapter.call(Executors.java:441)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask
>>>>>>>>>>> $Sync.innerRun(FutureTask.java:303)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.FutureTask.run(FutureTask.java:
>>>>>>>>>>> 138)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.runTask(ThreadPoolExecutor.java:885) at
>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:907) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"{felix.fileinstall.poll=5000,
>>>>>>>>>>> felix.fileinstall.bundles.new.start=false,
>>>>>>>>>>> felix.fileinstall.dir=/work/v3/glassfishv3/glassfish/
>>>>>>>>>>> modules/, felix.fileinstall.debug=1}" daemon prio=5
>>>>>>>>>>> tid=0x00000001030fd000 nid=0x1392d6000 waiting on
>>>>>>>>>>> condition [0x00000001392d5000..0x00000001392d5ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: TIMED_WAITING (sleeping)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Thread.sleep(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> org
>>>>>>>>>>> .apache
>>>>>>>>>>> .felix
>>>>>>>>>>> .fileinstall.DirectoryWatcher.run(DirectoryWatcher.java:
>>>>>>>>>>> 122) "Configuration Updater" daemon prio=5
>>>>>>>>>>> tid=0x00000001030fc000 nid=0x1391d3000 in Object.wait()
>>>>>>>>>>> [0x00000001391d2000..0x00000001391d2ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x0000000116185518> (a java.util.LinkedList)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Object.java:485)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.apac
>>>>>>>>>>> he.felix.cm.impl.UpdateThread.run(UpdateThread.java:67)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x0000000116185518> (a java.util.LinkedList)
>>>>>>>>>>> *
>>>>>>>>>>> *"telnetconsole.Listener" daemon prio=5
>>>>>>>>>>> tid=0x00000001030f2000 nid=0x1390d0000 runnable
>>>>>>>>>>> [0x00000001390cf000..0x00000001390cfad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: RUNNABLE
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.PlainSocketImpl.socketAccept(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:
>>>>>>>>>>> 384)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x0000000116185600> (a java.net.SocksSocketImpl)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.ServerSocket.implAccept(ServerSocket.java:453)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.net.ServerSocket.accept(ServerSocket.java:421)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.apache.felix.shell.remote.Listener
>>>>>>>>>>> $Acceptor.run(Listener.java:137)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"FelixPackageAdmin" daemon prio=5 tid=0x00000001030ea000
>>>>>>>>>>> nid=0x138fcd000 in Object.wait()
>>>>>>>>>>> [0x0000000138fcc000..0x0000000138fccad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x00000001161594d8> (a
>>>>>>>>>>> org.apache.felix.framework.PackageAdminImpl)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Object.java:485)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> org
>>>>>>>>>>> .apache
>>>>>>>>>>> .felix
>>>>>>>>>>> .framework.PackageAdminImpl.run(PackageAdminImpl.java:314)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x00000001161594d8> (a
>>>>>>>>>>> org.apache.felix.framework.PackageAdminImpl)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"FelixStartLevel" daemon prio=5 tid=0x00000001030e9800
>>>>>>>>>>> nid=0x138eca000 in Object.wait()
>>>>>>>>>>> [0x0000000138ec9000..0x0000000138ec9ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x0000000116159cd0> (a java.util.ArrayList)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Object.java:485)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> org
>>>>>>>>>>> .apache
>>>>>>>>>>> .felix.framework.StartLevelImpl.run(StartLevelImpl.java:241)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x0000000116159cd0> (a java.util.ArrayList)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"FelixDispatchQueue" daemon prio=5 tid=0x000000010309e000
>>>>>>>>>>> nid=0x138969000 in Object.wait()
>>>>>>>>>>> [0x0000000138968000..0x0000000138968ad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x0000000115a10ce0> (a java.util.ArrayList)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Object.java:485)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> org
>>>>>>>>>>> .apache
>>>>>>>>>>> .felix
>>>>>>>>>>> .framework.util.EventDispatcher.run(EventDispatcher.java:
>>>>>>>>>>> 875) - locked <0x0000000115a10ce0> (a
>>>>>>>>>>> java.util.ArrayList)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.apache.felix.framework.util.EventDispatcher.access
>>>>>>>>>>> $000(EventDispatcher.java:50) at
>>>>>>>>>>> org.apache.felix.framework.util.EventDispatcher
>>>>>>>>>>> $1.run(EventDispatcher.java:102) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"OSGi Framework Launcher" daemon prio=5
>>>>>>>>>>> tid=0x0000000103082000 nid=0x1380bd000 in Object.wait()
>>>>>>>>>>> [0x00000001380bb000..0x00000001380bcad0]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>>> *
>>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>>> *
>>>>>>>>>>> * - waiting on <0x000000011615b908> (a
>>>>>>>>>>> org.apache.felix.framework.util.ThreadGate)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> org
>>>>>>>>>>> .apache
>>>>>>>>>>> .felix.framework.util.ThreadGate.await(ThreadGate.java:48)
>>>>>>>>>>> *
>>>>>>>>>>> * - locked <0x000000011615b908> (a
>>>>>>>>>>> org.apache.felix.framework.util.ThreadGate)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> org.apache.felix.framework.Felix.waitForStop(Felix.java:785)
>>>>>>>>>>> *
>>>>>>>>>>> * at org.apache.felix.main.Main.main(Main.java:215)
>>>>>>>>>>> *
>>>>>>>>>>> * at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>>>>>>> Method)
>>>>>>>>>>> *
>>>>>>>>>>> * at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .NativeMethodAccessorImpl
>>>>>>>>>>> .invoke(NativeMethodAccessorImpl.java:39) at
>>>>>>>>>>> sun
>>>>>>>>>>> .reflect
>>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>> *
>>>>>>>>>>> * at com.sun.enterprise.glassfish.bootstrap.ASMainFelix
>>>>>>>>>>> $1.run(ASMainFelix.java:91) at
>>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>>> *
>>>>>>>>>>> *"Low Memory Detector" daemon prio=5
>>>>>>>>>>> tid=0x0000000103044800 nid=0x137ad5000 runnable
>>>>>>>>>>> [0x0000000000000000..0x0000000000000000]
>>>>>>>>>>> *
>>>>>>>>>>> *java.lang.Thread.State: RUNNABLE
>>>>>>>>>>> *
>>>>>>>>>> *"CompilerThread1" daemon prio=9 tid=0x0000000103043000
>>>>>>>>>> nid=0x1379d2000 waiting on condition
>>>>>>>>>> [0x0000000000000000..0x00000001379d03e0]
>>>>>>>>>> *
>>>>>>>>>> *java.lang.Thread.State: RUNNABLE
>>>>>>>>>> *
>>>>>>>>>> *"CompilerThread0" daemon prio=9 tid=0x0000000103041800
>>>>>>>>>> nid=0x1378cf000 waiting on condition
>>>>>>>>>> [0x0000000000000000..0x00000001378cd3e0]
>>>>>>>>>> *
>>>>>>>>>> *java.lang.Thread.State: RUNNABLE
>>>>>>>>>> *
>>>>>>>>>> *"Signal Dispatcher" daemon prio=9 tid=0x0000000103041000
>>>>>>>>>> nid=0x1377cc000 waiting on condition
>>>>>>>>>> [0x0000000000000000..0x0000000000000000]
>>>>>>>>>> *
>>>>>>>>>> *java.lang.Thread.State: RUNNABLE
>>>>>>>>>> *
>>>>>>>>>> *"Finalizer" daemon prio=8 tid=0x0000000103029800
>>>>>>>>>> nid=0x1376b2000 in Object.wait()
>>>>>>>>>> [0x00000001376b1000..0x00000001376b1ad0]
>>>>>>>>>> *
>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>> *
>>>>>>>>>> * - waiting on <0x0000000115997518> (a
>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
>>>>>>>>>> *
>>>>>>>>>> * - locked <0x0000000115997518> (a
>>>>>>>>>> java.lang.ref.ReferenceQueue$Lock)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.ref.Finalizer
>>>>>>>>>> $FinalizerThread.run(Finalizer.java:159)
>>>>>>>>>> *
>>>>>>>>>> *"Reference Handler" daemon prio=10 tid=0x0000000103028800
>>>>>>>>>> nid=0x1375a9000 in Object.wait()
>>>>>>>>>> [0x00000001375a8000..0x00000001375a8ad0]
>>>>>>>>>> *
>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>> *
>>>>>>>>>> * - waiting on <0x0000000115997190> (a
>>>>>>>>>> java.lang.ref.Reference$Lock)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Object.wait(Object.java:485)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.ref.Reference
>>>>>>>>>> $ReferenceHandler.run(Reference.java:116)
>>>>>>>>>> *
>>>>>>>>>> * - locked <0x0000000115997190> (a java.lang.ref.Reference
>>>>>>>>>> $Lock)
>>>>>>>>>> *
>>>>>>>>>> *"main" prio=5 tid=0x0000000103001000 nid=0x103901000 in
>>>>>>>>>> Object.wait() [0x0000000103900000..0x0000000103900c40]
>>>>>>>>>> *
>>>>>>>>>> *java.lang.Thread.State: WAITING (on object monitor)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Object.wait(Native Method)
>>>>>>>>>> *
>>>>>>>>>> * - waiting on <0x00000001159e6a00> (a java.lang.Thread)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Thread.join(Thread.java:1161)
>>>>>>>>>> *
>>>>>>>>>> * - locked <0x00000001159e6a00> (a java.lang.Thread)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Thread.join(Thread.java:1214)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .glassfish
>>>>>>>>>> .bootstrap.ASMainFelix.launchOSGiFW(ASMainFelix.java:
>>>>>>>>>> 110) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .glassfish.bootstrap.ASMainOSGi.run(ASMainOSGi.java:137)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com
>>>>>>>>>> .sun.enterprise.glassfish.bootstrap.ASMain.main(ASMain.java:
>>>>>>>>>> 65)
>>>>>>>>>> *
>>>>>>>>>> *"VM Thread" prio=9 tid=0x0000000103020800 nid=0x1374a6000
>>>>>>>>>> runnable
>>>>>>>>>> *
>>>>>>>>>> *"VM Periodic Task Thread" prio=10 tid=0x0000000103046000
>>>>>>>>>> nid=0x137bd8000 waiting on condition
>>>>>>>>>> *
>>>>>>>>>> *"Exception Catcher Thread" prio=10 tid=0x0000000103002000
>>>>>>>>>> nid=0x103a04000 runnable
>>>>>>>>>> *
>>>>>>>>>> *JNI global references: 819
>>>>>>>>>> *
>>>>>>>>>> *Found one Java-level deadlock:
>>>>>>>>>> *
>>>>>>>>>> *=============================
>>>>>>>>>> *
>>>>>>>>>> *"ComplianceMonitor.ValidatorThread":
>>>>>>>>>> *
>>>>>>>>>> *waiting to lock monitor 0x0000000139935b98 (object
>>>>>>>>>> 0x000000011599a0b8, a java.util.logging.LogManager),
>>>>>>>>>> *
>>>>>>>>>> *which is held by "RMI TCP Connection(4)-192.168.1.5"
>>>>>>>>>> *
>>>>>>>>>> *"RMI TCP Connection(4)-192.168.1.5":
>>>>>>>>>> *
>>>>>>>>>> *waiting to lock monitor 0x0000000139976ec8 (object
>>>>>>>>>> 0x000000012b1c11b0, a java.lang.Class),
>>>>>>>>>> *
>>>>>>>>>> *which is held by "ComplianceMonitor.ValidatorThread"
>>>>>>>>>> *
>>>>>>>>>> *Java stack information for the threads listed above:
>>>>>>>>>> *
>>>>>>>>>> *===================================================
>>>>>>>>>> *
>>>>>>>>>> *"ComplianceMonitor.ValidatorThread":
>>>>>>>>>> *
>>>>>>>>>> * at java.util.logging.LogManager.getLogger(LogManager.java:
>>>>>>>>>> 550)
>>>>>>>>>> *
>>>>>>>>>> * - waiting to lock <0x000000011599a0b8> (a
>>>>>>>>>> java.util.logging.LogManager)
>>>>>>>>>> *
>>>>>>>>>> * at java.util.logging.Logger.getLogger(Logger.java:275)
>>>>>>>>>> *
>>>>>>>>>> * - locked <0x000000012b1c11b0> (a java.lang.Class for
>>>>>>>>>> java.util.logging.Logger)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com.sun.jmx.trace.TraceManager.getLogger(TraceManager.java:
>>>>>>>>>> 166)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com.sun.jmx.trace.TraceManager.isSelected(TraceManager.java:
>>>>>>>>>> 197)
>>>>>>>>>> *
>>>>>>>>>> * at com.sun.jmx.trace.Trace.isSelected(Trace.java:84)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .isTraceOn(DefaultMBeanServerInterceptor.java:1832) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .getAttribute(DefaultMBeanServerInterceptor.java:657)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .mbeanserver
>>>>>>>>>> .JmxMBeanServer.getAttribute(JmxMBeanServer.java:638)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .util
>>>>>>>>>> .jmx.MBeanProxyHandler.getAttribute(MBeanProxyHandler.java:
>>>>>>>>>> 251) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .util
>>>>>>>>>> .jmx
>>>>>>>>>> .MBeanProxyHandler
>>>>>>>>>> .getAttributeNoThrow(MBeanProxyHandler.java:263) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core
>>>>>>>>>> .proxy.AMXProxyHandler.getChildren(AMXProxyHandler.java:
>>>>>>>>>> 792) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core
>>>>>>>>>> .proxy.AMXProxyHandler.childrenSet(AMXProxyHandler.java:
>>>>>>>>>> 810) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core
>>>>>>>>>> .proxy
>>>>>>>>>> .AMXProxyHandler.handleSpecialMethod(AMXProxyHandler.java:
>>>>>>>>>> 421) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core.proxy.AMXProxyHandler._invoke(AMXProxyHandler.java:
>>>>>>>>>> 594) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.core.proxy.AMXProxyHandler.invoke(AMXProxyHandler.java:
>>>>>>>>>> 552) at $Proxy66.childrenSet(Unknown Source)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listChildren(PathnamesImpl.java:
>>>>>>>>>> 226) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listChildren(PathnamesImpl.java:
>>>>>>>>>> 234) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listChildren(PathnamesImpl.java:
>>>>>>>>>> 245) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl.path.PathnamesImpl.listObjectNames(PathnamesImpl.java:
>>>>>>>>>> 261) at
>>>>>>>>>> sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.impl.mbean.AMXImplBase.invoke(AMXImplBase.java:
>>>>>>>>>> 1082) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .invoke(DefaultMBeanServerInterceptor.java:836) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:
>>>>>>>>>> 761)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> javax
>>>>>>>>>> .management
>>>>>>>>>> .MBeanServerInvocationHandler
>>>>>>>>>> .invoke(MBeanServerInvocationHandler.java:288) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .util.jmx.MBeanProxyHandler.invoke(MBeanProxyHandler.java:
>>>>>>>>>> 467) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .core.proxy.AMXProxyHandler._invoke(AMXProxyHandler.java:
>>>>>>>>>> 605) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.core.proxy.AMXProxyHandler.invoke(AMXProxyHandler.java:
>>>>>>>>>> 552) at $Proxy69.listObjectNames(Unknown Source)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.core.AMXValidator.validate(AMXValidator.java:318)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.core.AMXValidator.validate(AMXValidator.java:331)
>>>>>>>>>> *
>>>>>>>>>> * at org.glassfish.admin.amx.impl.mbean.ComplianceMonitor
>>>>>>>>>> $ValidatorThread.doRun(ComplianceMonitor.java:134) at
>>>>>>>>>> org.glassfish.admin.amx.impl.mbean.ComplianceMonitor
>>>>>>>>>> $ValidatorThread.run(ComplianceMonitor.java:118) "RMI TCP
>>>>>>>>>> Connection(4)-192.168.1.5":
>>>>>>>>>> *
>>>>>>>>>> * at java.util.logging.Logger.getLogger(Logger.java:274)
>>>>>>>>>> *
>>>>>>>>>> * - waiting to lock <0x000000012b1c11b0> (a java.lang.Class
>>>>>>>>>> for java.util.logging.Logger)
>>>>>>>>>> *
>>>>>>>>>> * at java.util.logging.LogManager.addLogger(LogManager.java:
>>>>>>>>>> 399)
>>>>>>>>>> *
>>>>>>>>>> * - locked <0x000000011599a0b8> (a
>>>>>>>>>> java.util.logging.LogManager)
>>>>>>>>>> *
>>>>>>>>>> * at com.sun.logging.LogDomains.getLogger(LogDomains.java:
>>>>>>>>>> 331)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .appserv.security.AppservRealm.<clinit>(AppservRealm.java:64)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .reflect.NativeConstructorAccessorImpl.newInstance0(Native
>>>>>>>>>> Method)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .NativeConstructorAccessorImpl
>>>>>>>>>> .newInstance(NativeConstructorAccessorImpl.java:39) at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .DelegatingConstructorAccessorImpl
>>>>>>>>>> .newInstance(DelegatingConstructorAccessorImpl.java:27)
>>>>>>>>>> at
>>>>>>>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:
>>>>>>>>>> 513)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Class.newInstance0(Class.java:355)
>>>>>>>>>> *
>>>>>>>>>> * at java.lang.Class.newInstance(Class.java:308)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .security.auth.realm.Realm.doInstantiate(Realm.java:243)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .enterprise
>>>>>>>>>> .security.auth.realm.Realm.instantiate(Realm.java:165)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.impl.ext.RealmsMgrImpl.loadRealms(RealmsMgrImpl.java:
>>>>>>>>>> 111) - locked <0x000000010b9c05c8> (a
>>>>>>>>>> org.glassfish.admin.amx.impl.ext.RealmsMgrImpl)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.impl.ext.RealmsMgrImpl.getRealm(RealmsMgrImpl.java:
>>>>>>>>>> 166) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.impl.ext.RealmsMgrImpl.getUserNames(RealmsMgrImpl.java:
>>>>>>>>>> 252) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl
>>>>>>>>>> .ext.RealmsMgrImpl.getAnonymousLogin(RealmsMgrImpl.java:
>>>>>>>>>> 360) at
>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .NativeMethodAccessorImpl
>>>>>>>>>> .invoke(NativeMethodAccessorImpl.java:39) at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl
>>>>>>>>>> .mbean.AMXImplBase.getAttributeByMethod(AMXImplBase.java:
>>>>>>>>>> 588) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .impl
>>>>>>>>>> .mbean.AMXImplBase.getAttributeInternal(AMXImplBase.java:
>>>>>>>>>> 505) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx.impl.mbean.AMXImplBase.getAttribute(AMXImplBase.java:
>>>>>>>>>> 460) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .getAttribute(DefaultMBeanServerInterceptor.java:666)
>>>>>>>>>> at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .mbeanserver
>>>>>>>>>> .JmxMBeanServer.getAttribute(JmxMBeanServer.java:638)
>>>>>>>>>> at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin
>>>>>>>>>> .amx
>>>>>>>>>> .util
>>>>>>>>>> .jmx.MBeanProxyHandler.getAttribute(MBeanProxyHandler.java:
>>>>>>>>>> 251) at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.core.AMXValidator._validate(AMXValidator.java:199)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.core.AMXValidator.validate(AMXValidator.java:322)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.impl.mbean.ToolsImpl.validate(ToolsImpl.java:157)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.impl.mbean.ToolsImpl.validate(ToolsImpl.java:169)
>>>>>>>>>> *
>>>>>>>>>> * at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>>>>>>> Method)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .NativeMethodAccessorImpl
>>>>>>>>>> .invoke(NativeMethodAccessorImpl.java:39) at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> org
>>>>>>>>>> .glassfish
>>>>>>>>>> .admin.amx.impl.mbean.AMXImplBase.invoke(AMXImplBase.java:
>>>>>>>>>> 1082) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx
>>>>>>>>>> .interceptor
>>>>>>>>>> .DefaultMBeanServerInterceptor
>>>>>>>>>> .invoke(DefaultMBeanServerInterceptor.java:836) at
>>>>>>>>>> com
>>>>>>>>>> .sun
>>>>>>>>>> .jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:
>>>>>>>>>> 761)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> javax
>>>>>>>>>> .management
>>>>>>>>>> .remote
>>>>>>>>>> .rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:
>>>>>>>>>> 1426) at
>>>>>>>>>> javax.management.remote.rmi.RMIConnectionImpl.access
>>>>>>>>>> $200(RMIConnectionImpl.java:72) at
>>>>>>>>>> javax.management.remote.rmi.RMIConnectionImpl
>>>>>>>>>> $PrivilegedOperation.run(RMIConnectionImpl.java:1264)
>>>>>>>>>> at
>>>>>>>>>> javax
>>>>>>>>>> .management
>>>>>>>>>> .remote
>>>>>>>>>> .rmi
>>>>>>>>>> .RMIConnectionImpl
>>>>>>>>>> .doPrivilegedOperation(RMIConnectionImpl.java:1359) at
>>>>>>>>>> javax
>>>>>>>>>> .management
>>>>>>>>>> .remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:
>>>>>>>>>> 788) at
>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .NativeMethodAccessorImpl
>>>>>>>>>> .invoke(NativeMethodAccessorImpl.java:39) at
>>>>>>>>>> sun
>>>>>>>>>> .reflect
>>>>>>>>>> .DelegatingMethodAccessorImpl
>>>>>>>>>> .invoke(DelegatingMethodAccessorImpl.java:25) at
>>>>>>>>>> java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:
>>>>>>>>>> 305)
>>>>>>>>>> *
>>>>>>>>>> * at sun.rmi.transport.Transport$1.run(Transport.java:159)
>>>>>>>>>> *
>>>>>>>>>> * at java.security.AccessController.doPrivileged(Native
>>>>>>>>>> Method)
>>>>>>>>>> *
>>>>>>>>>> * at sun.rmi.transport.Transport.serviceCall(Transport.java:
>>>>>>>>>> 155)
>>>>>>>>>> *
>>>>>>>>>> * at
>>>>>>>>>> sun
>>>>>>>>>> .rmi
>>>>>>>>>> .transport
>>>>>>>>>> .tcp.TCPTransport.handleMessages(TCPTransport.java:535)
>>>>>>>>>> *
>>>>>>>>>> * at sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>> $ConnectionHandler.run0(TCPTransport.java:790) at
>>>>>>>>>> sun.rmi.transport.tcp.TCPTransport
>>>>>>>>>> $ConnectionHandler.run(TCPTransport.java:649) at
>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>> $Worker.runTask(ThreadPoolExecutor.java:885) at
>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor
>>>>>>>>>> $Worker.run(ThreadPoolExecutor.java:907) at
>>>>>>>>>> java.lang.Thread.run(Thread.java:637)
>>>>>>>>>> *
>>>>>>>>>> *Found 1 deadlock.
>>>>>>>>>> *
>>>>>>>>>> *Heap
>>>>>>>>>> *
>>>>>>>>>> *def new generation total 13056K, used 3194K
>>>>>>>>>> [0x000000010aed0000, 0x000000010bd60000, 0x0000000115970000)
>>>>>>>>>> *
>>>>>>>>>> *eden space 11200K, 20% used [0x000000010aed0000,
>>>>>>>>>> 0x000000010b1141d0, 0x000000010b9c0000)
>>>>>>>>>> *
>>>>>>>>>> *from space 1856K, 47% used [0x000000010b9c0000,
>>>>>>>>>> 0x000000010ba9a7f8, 0x000000010bb90000)
>>>>>>>>>> *
>>>>>>>>>> *to space 1856K, 0% used [0x000000010bb90000,
>>>>>>>>>> 0x000000010bb90000, 0x000000010bd60000)
>>>>>>>>>> *
>>>>>>>>>> *tenured generation total 29580K, used 23266K
>>>>>>>>>> [0x0000000115970000, 0x0000000117653000, 0x000000012aed0000)
>>>>>>>>>> *
>>>>>>>>>> *the space 29580K, 78% used [0x0000000115970000,
>>>>>>>>>> 0x0000000117028970, 0x0000000117028a00, 0x0000000117653000)
>>>>>>>>>> *
>>>>>>>>>> *compacting perm gen total 25408K, used 25108K
>>>>>>>>>> [0x000000012aed0000, 0x000000012c7a0000, 0x0000000136ed0000)
>>>>>>>>>> *
>>>>>>>>>> *the space 25408K, 98% used [0x000000012aed0000,
>>>>>>>>>> 0x000000012c7552d0, 0x000000012c755400, 0x000000012c7a0000)
>>>>>>>>>> *
>>>>>>>>>> *No shared spaces configured.
>>>>>>>>>> *
>>>>>>>>>> *---------------------------------------------------------------------
>>>>>>>>>> *
>>>>>>>>>> *To unsubscribe, e-mail: dev-unsubscribe_at_glassfish.dev.java.net
>>>>>>>>>> <mailto:dev-unsubscribe_at_glassfish.dev.java.net> <mailto:dev-unsubscribe_at_glassfish.dev.java.net
>>>>>>>>>> >
>>>>>>>>>> *
>>>>>>>>>> *For additional commands, e-mail: dev-help_at_glassfish.dev.java.net
>>>>>>>>>> <mailto:dev-help_at_glassfish.dev.java.net> <mailto:dev-help_at_glassfish.dev.java.net
>>>>>>>>>> >
>>>>>>>>>> *
>>>>>>>>> *
>>>>>>>>> *
>>>>>>>>> *
>>>>>>>>> *
>>>>>>>>> *---------------------------------------------------------------------
>>>>>>>>> *
>>>>>>>>> *To unsubscribe, e-mail: dev-unsubscribe_at_glassfish.dev.java.net
>>>>>>>>> <mailto:dev-unsubscribe_at_glassfish.dev.java.net> <mailto:dev-unsubscribe_at_glassfish.dev.java.net
>>>>>>>>> >
>>>>>>>>> *
>>>>>>>>> *For additional commands, e-mail: dev-help_at_glassfish.dev.java.net
>>>>>>>>> <mailto:dev-help_at_glassfish.dev.java.net> <mailto:dev-help_at_glassfish.dev.java.net
>>>>>>>>> >
>>>>>>>>> *
>>>>>>>>> *
>>>>>>>>> *
>>>>>>>> *Lloyd Chambers
>>>>>>>> *
>>>>>>>> *lloyd.chambers_at_sun.com <mailto:lloyd.chambers_at_sun.com> <mailto:lloyd.chambers_at_sun.com
>>>>>>>> >
>>>>>>>> *
>>>>>>>> *GlassFish Team
>>>>>>>> *
>>>>>>> *
>>>>>>> *
>>>>>>> *
>>>>>>> *
>>>>>>> *---------------------------------------------------------------------
>>>>>>> *
>>>>>>> *To unsubscribe, e-mail: dev-
>>>>>>> unsubscribe_at_glassfish.dev.java.net <mailto:dev-unsubscribe_at_glassfish.dev.java.net
>>>>>>> > <mailto:dev-unsubscribe_at_glassfish.dev.java.net>
>>>>>>> *
>>>>>>> *For additional commands, e-mail: dev-help_at_glassfish.dev.java.net
>>>>>>> <mailto:dev-help_at_glassfish.dev.java.net> <mailto:dev-help_at_glassfish.dev.java.net
>>>>>>> >
>>>>>>> *
>>>>>>> *
>>>>>>> *
>>>>>> *
>>>>>> *
>>>>>> *
>>>>>> *
>>>>>> *---------------------------------------------------------------------
>>>>>> *
>>>>>> *To unsubscribe, e-mail: dev-unsubscribe_at_glassfish.dev.java.net
>>>>>> <mailto:dev-unsubscribe_at_glassfish.dev.java.net> <mailto:dev-unsubscribe_at_glassfish.dev.java.net
>>>>>> >
>>>>>> *
>>>>>> *For additional commands, e-mail: dev-
>>>>>> help_at_glassfish.dev.java.net <mailto:dev-help_at_glassfish.dev.java.net
>>>>>> > <mailto:dev-help_at_glassfish.dev.java.net>
>>>>>> *
>>>>>> *
>>>>>> *
>>>> *Lloyd Chambers
>>>> *
>>>> *lloyd.chambers_at_sun.com <mailto:lloyd.chambers_at_sun.com> <mailto:lloyd.chambers_at_sun.com
>>>> >
>>>> *
>>>> *GlassFish Team
>>>> *
>>> *
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe_at_glassfish.dev.java.net <mailto:dev-unsubscribe_at_glassfish.dev.java.net
>>> >
>>> For additional commands, e-mail: dev-help_at_glassfish.dev.java.net <mailto:dev-help_at_glassfish.dev.java.net
>>> >
>>>
>>> *
>> *
>> *
>> *
>> Lloyd Chambers
>> lloyd.chambers_at_sun.com <mailto:lloyd.chambers_at_sun.com>
>> GlassFish Team
>> *
>> *
>> *
>> *
>> *
>> *
>> Lloyd Chambers
>> lloyd.chambers_at_sun.com <mailto:lloyd.chambers_at_sun.com>
>> GlassFish Team
>> *
>> *
>> *
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe_at_glassfish.dev.java.net
> For additional commands, e-mail: dev-help_at_glassfish.dev.java.net
>

Lloyd Chambers
lloyd.chambers_at_sun.com
GlassFish Team