users@glassfish.java.net

Glassfish Cluster instances not starting up

From: <glassfish_at_javadesktop.org>
Date: Thu, 16 Apr 2009 12:35:46 PDT

We had a clsuter with 2 node agents and when the instances are coming up we are getting following problem. Any help will be greatly appreciated.

Apr 16, 2009 3:12:39 PM com.sun.enterprise.admin.servermgmt.launch.ASLauncher buildCommand
INFO:
/usr/local/JAVA/jdk1.6.0_13/bin/java
-Dcom.sun.aas.instanceRoot=/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03
-DHTTP_LISTENER_PORT=38080
-DHTTP_SSL_LISTENER_PORT=38181
-DIIOP_LISTENER_PORT=33700
-DIIOP_SSL_LISTENER_PORT=33820
-DIIOP_SSL_MUTUALAUTH_PORT=33920
-DJMS_PROVIDER_PORT=37676
-DJMX_SYSTEM_CONNECTOR_PORT=38686
-Dcom.sun.aas.ClassPathPrefix=
-Dcom.sun.aas.ClassPathSuffix=
-Dcom.sun.aas.ServerClassPath=
-Dcom.sun.aas.classloader.appserverChainJars.ee=
-Dcom.sun.aas.classloader.appserverChainJars=admin-cli.jar,admin-cli-ee.jar,j2ee-svc.jar
-Dcom.sun.aas.classloader.excludesList=admin-cli.jar,appserv-upgrade.jar,sun-appserv-ant.jar
-Dcom.sun.aas.classloader.optionalOverrideableChain.ee=
-Dcom.sun.aas.classloader.optionalOverrideableChain=webservices-rt.jar,webservices-tools.jar
-Dcom.sun.aas.classloader.serverClassPath.ee=/apps02/sunapp2/hadb/4.4.3-6/lib/hadbjdbc4.jar,/apps02/sunapp2/lib/SUNWjdmk/5.1/lib/jdmkrt.jar,/apps02/sunapp2/hadb/4.4.3-6/lib/dbstate.jar,/apps02/sunapp2/hadb/4.4.3-6/lib/hadbm.jar,/apps02/sunapp2/hadb/4.4.3-6/lib/hadbmgt.jar,/opt/SUNWmfwk/lib/mfwk_instrum_tk.jar
-Dcom.sun.aas.classloader.serverClassPath=/apps02/sunapp2/lib/install/applications/jmsra/imqjmsra.jar,/apps02/sunapp2/imq/lib/jaxm-api.jar,/apps02/sunapp2/imq/lib/fscontext.jar,/apps02/sunapp2/imq/lib/imqbroker.jar,/apps02/sunapp2/imq/lib/imqjmx.jar,/apps02/sunapp2/lib/ant/lib/ant.jar,/apps02/sunapp2/lib/SUNWjdmk/5.1/lib/jdmkrt.jar
-Dcom.sun.aas.classloader.sharedChainJars.ee=appserv-se.jar,appserv-ee.jar,jesmf-plugin.jar,/apps02/sunapp2/hadb/4.4.3-6/lib/dbstate.jar,/apps02/sunapp2/hadb/4.4.3-6/lib/hadbjdbc4.jar,jgroups-all.jar,/opt/SUNWmfwk/lib/mfwk_instrum_tk.jar
-Dcom.sun.aas.classloader.sharedChainJars=javaee.jar,/usr/local/JAVA/jdk1.6.0_13/lib/tools.jar,install/applications/jmsra/imqjmsra.jar,com-sun-commons-launcher.jar,com-sun-commons-logging.jar,/apps02/sunapp2/imq/lib/jaxm-api.jar,/apps02/sunapp2/imq/lib/fscontext.jar,/apps02/sunapp2/imq/lib/imqbroker.jar,/apps02/sunapp2/imq/lib/imqjmx.jar,/apps02/sunapp2/imq/lib/imqxm.jar,webservices-rt.jar,webservices-tools.jar,mail.jar,appserv-jstl.jar,jmxremote_optional.jar,/apps02/sunapp2/lib/SUNWjdmk/5.1/lib/jdmkrt.jar,activation.jar,appserv-rt.jar,appserv-admin.jar,appserv-cmp.jar,/apps02/sunapp2/updatecenter/lib/updatecenter.jar,/apps02/sunapp2/jbi/lib/jbi.jar,/apps02/sunapp2/imq/lib/imqjmx.jar,/apps02/sunapp2/lib/ant/lib/ant.jar,dbschema.jar
-Dcom.sun.aas.configName=soacluster-config
-Dcom.sun.aas.configRoot=/apps02/sunapp2/config
-Dcom.sun.aas.defaultLogFile=/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03/logs/server.log
-Dcom.sun.aas.domainName=domain1
-Dcom.sun.aas.installRoot=/apps02/sunapp2
-Dcom.sun.aas.instanceName=soa07d-03
-Dcom.sun.aas.processLauncher=SE
-Dcom.sun.aas.promptForIdentity=true
-Dcom.sun.appserv.nss.db=/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03/config
-Dcom.sun.appserv.pluggable.features=com.sun.enterprise.ee.server.pluggable.EEPluggableFeatureImpl
-Dcom.sun.enterprise.config.config_environment_factory_class=com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory
-Dcom.sun.enterprise.overrideablejavaxpackages=javax.help,javax.portlet
-Dcom.sun.enterprise.taglibs=appserv-jstl.jar,jsf-impl.jar
-Dcom.sun.enterprise.taglisteners=jsf-impl.jar
-Dcom.sun.updatecenter.home=/apps02/sunapp2/updatecenter
-Ddomain.name=domain1
-Djava.endorsed.dirs=/apps02/sunapp2/lib/endorsed
-Djava.ext.dirs=/usr/local/JAVA/jdk1.6.0_13/lib/ext:/usr/local/JAVA/jdk1.6.0_13/jre/lib/ext:/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03/lib/ext:/apps02/sunapp2/javadb/lib:/apps02/sunapp2/lib/jdbcdrivers
-Djava.library.path=/apps02/sunapp2/lib:/apps02/sunapp2/lib:/apps02/sunapp2/lib
-Djava.security.auth.login.config=/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03/config/login.conf
-Djava.security.manager
-Djava.security.policy=/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03/config/server.policy
-Djava.util.logging.manager=com.sun.enterprise.server.logging.ServerLogManager
-Djavax.management.builder.initial=com.sun.enterprise.ee.admin.AppServerMBeanServerBuilder
-Djdbc.drivers=org.apache.derby.jdbc.ClientDriver
-Djmx.invoke.getters=true
-Dsun.rmi.dgc.client.gcInterval=3600000
-Dsun.rmi.dgc.server.gcInterval=3600000
-server
-XX:+UnlockDiagnosticVMOptions
-XX:MaxPermSize=2048m
-Xmx512m
-XX:NewRatio=2
-XX:+LogVMOutput
-XX:LogFile=/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03/logs/jvm.log
-cp
/apps02/sunapp2/lib/jhall.jar:/apps02/sunapp2/lib/appserv-launch.jar
com.sun.enterprise.server.PELaunch
start
[#|2009-04-16T15:12:43.866-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;Java HotSpot(TM) Server VM;1.6.0_13;Sun Microsystems Inc.;|CORE5076: Using [Java HotSpot(TM) Server VM, Version 1.6.0_13] from [Sun Microsystems Inc.]|#]

[#|2009-04-16T15:12:44.162-0400|INFO|sun-appserver9.1|javax.enterprise.system.core.security|_ThreadID=11;_ThreadName=pool-1-thread-4;|SEC1001: Security Manager is ON.|#]

[#|2009-04-16T15:12:44.177-0400|INFO|sun-appserver9.1|javax.enterprise.resource.jms|_ThreadID=12;_ThreadName=pool-1-thread-7;|Using MQ RA for Broker lifecycle control|#]

[#|2009-04-16T15:12:44.210-0400|INFO|sun-appserver9.1|javax.enterprise.system.stream.out|_ThreadID=12;_ThreadName=pool-1-thread-7;|Called upgradeIf....|#]

[#|2009-04-16T15:12:46.367-0400|INFO|sun-appserver9.1|javax.enterprise.system.stream.out|_ThreadID=10;_ThreadName=main;|
/apps02/sunapp2/nodeagents/acrcxznxx07d-03/soa07d-03/config/.__com_sun_appserv_pid|#]

[#|2009-04-16T15:12:46.877-0400|INFO|sun-appserver9.1|javax.enterprise.system.tools.admin|_ThreadID=10;_ThreadName=main;|ADM0001:SunoneInterceptor is now enabled|#]

[#|2009-04-16T15:12:46.988-0400|INFO|sun-appserver9.1|javax.ee.enterprise.system.gms|_ThreadID=10;_ThreadName=main;|Initializing and Starting GroupManagementService|#]

[#|2009-04-16T15:12:51.035-0400|INFO|sun-appserver9.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;|GMS View Change Received: Members in view (before change analysis) are :
1: MemberId: soa07d-03, MemberType: CORE, Address: urn:jxta:uuid-AB391CAC1AC9486A8D1EB252F78D68A7EB93218F204443DD8E4EA41A26A3182703
|#]

[#|2009-04-16T15:12:51.042-0400|INFO|sun-appserver9.1|ShoalLogger|_ThreadID=13;_ThreadName=ViewWindowThread;MASTER_CHANGE_EVENT;|Analyzing new membership snapshot received as part of event : MASTER_CHANGE_EVENT|#]

[#|2009-04-16T15:12:51.945-0400|INFO|sun-appserver9.1|javax.enterprise.system.core.security|_ThreadID=10;_ThreadName=main;com.sun.enterprise.security.provider.PolicyWrapper;|SEC1143: Loading policy provider com.sun.enterprise.security.provider.PolicyWrapper.|#]

[#|2009-04-16T15:12:56.708-0400|INFO|sun-appserver9.1|javax.enterprise.system.container.ejb|_ThreadID=10;_ThreadName=main;|EJBSCLookup:: sc.getEjbContainerAvailabilityEnabledFromConfig() ==> true|#]

[#|2009-04-16T15:12:58.529-0400|INFO|sun-appserver9.1|javax.enterprise.system.core.transaction|_ThreadID=10;_ThreadName=main;33700;|JTS5014: Recoverable JTS instance, serverId = [33700]|#]

[#|2009-04-16T15:12:58.940-0400|INFO|sun-appserver9.1|javax.enterprise.system.tools.admin|_ThreadID=10;_ThreadName=main;|ADM1079: Initialization of AMX MBeans started|#]

[#|2009-04-16T15:13:00.162-0400|INFO|sun-appserver9.1|javax.enterprise.system.tools.admin|_ThreadID=14;_ThreadName=Thread-17;service:jmx:rmi:///jndi/rmi://acrcxznxx07d-03:38686/jmxrmi;|ADM1504: Here is the JMXServiceURL for the Standard JMXConnectorServer: [service:jmx:rmi:///jndi/rmi://acrcxznxx07d-03:38686/jmxrmi]. This is where the remote administrative clients should connect using the standard JMX connectors|#]

[#|2009-04-16T15:13:00.163-0400|INFO|sun-appserver9.1|javax.enterprise.system.tools.admin|_ThreadID=14;_ThreadName=Thread-17;true;|ADM1506: Status of Standard JMX Connector: Active = [true]|#]

[#|2009-04-16T15:13:01.649-0400|INFO|sun-appserver9.1|javax.enterprise.resource.resourceadapter|_ThreadID=10;_ThreadName=main;|JMS Service Connection URL is :mq://acrcxznxx07d-03:37676/,mq://acrcxznxx06d-03:37676/|#]

[#|2009-04-16T15:13:01.662-0400|SEVERE|sun-appserver9.1|javax.enterprise.resource.resourceadapter|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|RAR6035 : Resource adapter start failed : {0}
java.lang.NullPointerException
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.setAvailabilityProperties(ActiveJmsResourceAdapter.java:383)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.loadRAConfiguration(ActiveJmsResourceAdapter.java:280)
        at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.<init>(ActiveInboundResourceAdapter.java:120)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.<init>(ActiveJmsResourceAdapter.java:248)
        at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
        at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:225)
        at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:430)
        at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:442)
        at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:120)
        at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
        at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
|#]

[#|2009-04-16T15:13:01.676-0400|WARNING|sun-appserver9.1|javax.enterprise.system.stream.err|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|java.lang.NullPointerException
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.setAvailabilityProperties(ActiveJmsResourceAdapter.java:383)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.loadRAConfiguration(ActiveJmsResourceAdapter.java:280)
        at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.<init>(ActiveInboundResourceAdapter.java:120)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.<init>(ActiveJmsResourceAdapter.java:248)
        at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
        at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:225)
        at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:430)
        at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:442)
        at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:120)
        at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
        at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
|#]

[#|2009-04-16T15:13:01.689-0400|WARNING|sun-appserver9.1|javax.enterprise.system.stream.err|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|
com.sun.enterprise.connectors.ConnectorRuntimeException: Failed to start resource adapter : null
        at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.<init>(ActiveInboundResourceAdapter.java:166)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.<init>(ActiveJmsResourceAdapter.java:248)
        at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
        at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:225)
        at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:430)
        at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:442)
        at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:120)
        at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
        at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
Caused by: java.lang.NullPointerException
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.setAvailabilityProperties(ActiveJmsResourceAdapter.java:383)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.loadRAConfiguration(ActiveJmsResourceAdapter.java:280)
        at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.<init>(ActiveInboundResourceAdapter.java:120)
        ... 15 more
|#]

[#|2009-04-16T15:13:01.693-0400|INFO|sun-appserver9.1|javax.enterprise.resource.jms|_ThreadID=10;_ThreadName=main;|Failed to start JMS RA|#]

[#|2009-04-16T15:13:01.695-0400|SEVERE|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;com.sun.enterprise.jms.JmsProviderLifecycle_at_592bb1;com.sun.appserv.server.ServerLifecycleException: Failed to start JMS RA;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|Service com.sun.enterprise.jms.JmsProviderLifecycle_at_592bb1 cannot be started! : com.sun.appserv.server.ServerLifecycleException: Failed to start JMS RA|#]

[#|2009-04-16T15:13:01.696-0400|SEVERE|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|CORE5071: An error occured during initialization
com.sun.appserv.server.ServerLifecycleException: Failed to start JMS RA
        at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:443)
        at com.sun.enterprise.server.ApplicationServer.onStartup(ApplicationServer.java:442)
        at com.sun.enterprise.server.ondemand.OnDemandServer.onStartup(OnDemandServer.java:120)
        at com.sun.enterprise.server.PEMain.run(PEMain.java:409)
        at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
Caused by: com.sun.enterprise.connectors.ConnectorRuntimeException: Failed to start resource adapter : null
        at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.<init>(ActiveInboundResourceAdapter.java:166)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.<init>(ActiveJmsResourceAdapter.java:248)
        at com.sun.enterprise.connectors.ActiveRAFactory.createActiveResourceAdapter(ActiveRAFactory.java:107)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:300)
        at com.sun.enterprise.connectors.ResourceAdapterAdminServiceImpl.createActiveResourceAdapter(ResourceAdapterAdminServiceImpl.java:445)
        at com.sun.enterprise.connectors.ConnectorRuntime.createActiveResourceAdapter(ConnectorRuntime.java:225)
        at com.sun.enterprise.jms.JmsProviderLifecycle.onStartup(JmsProviderLifecycle.java:430)
        ... 9 more
Caused by: java.lang.NullPointerException
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.setAvailabilityProperties(ActiveJmsResourceAdapter.java:383)
        at com.sun.enterprise.connectors.system.ActiveJmsResourceAdapter.loadRAConfiguration(ActiveJmsResourceAdapter.java:280)
        at com.sun.enterprise.connectors.ActiveInboundResourceAdapter.<init>(ActiveInboundResourceAdapter.java:120)
        ... 15 more
|#]

[#|2009-04-16T15:13:01.700-0400|SEVERE|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|Server Startup failed. Exiting...|#]

[#|2009-04-16T15:13:01.701-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|Server shutdown in progress...|#]

[#|2009-04-16T15:13:01.714-0400|INFO|sun-appserver9.1|javax.enterprise.system.container.web|_ThreadID=10;_ThreadName=main;|WEB0303: Stopping Sun-Java-System/Application-Server.|#]

[#|2009-04-16T15:13:01.716-0400|WARNING|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|CORE5061: Exception :
com.sun.appserv.server.ServerLifecycleException: WEB0106: An error occurred while stopping the web container
        at com.sun.enterprise.web.PEWebContainer.stopInstance(PEWebContainer.java:823)
        at com.sun.enterprise.web.PEWebContainerLifecycle.onShutdown(PEWebContainerLifecycle.java:95)
        at com.sun.enterprise.server.ApplicationServer.onShutdown(ApplicationServer.java:549)
        at com.sun.enterprise.server.ondemand.OnDemandServer.onShutdown(OnDemandServer.java:131)
        at com.sun.enterprise.server.PEMain.run(PEMain.java:427)
        at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
Caused by: LifecycleException: WEB0103: This web container has not yet been started
        at com.sun.enterprise.web.WebContainer.stop(WebContainer.java:918)
        at com.sun.enterprise.web.PEWebContainer.stopInstance(PEWebContainer.java:815)
        ... 10 more
|#]

[#|2009-04-16T15:13:01.719-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE5051: Shutting down all J2EE applications ...|#]

[#|2009-04-16T15:13:01.720-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE 5060 : Stopping all J2EE Connector 1.5 Compliant resource adapters ...|#]

[#|2009-04-16T15:13:01.722-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE 5061 : Resource adapters Stop() Complete|#]

[#|2009-04-16T15:13:01.722-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;|CORE5052: Application shutdown complete.|#]

[#|2009-04-16T15:13:01.723-0400|WARNING|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|CORE5061: Exception :
java.lang.NullPointerException
        at com.sun.enterprise.util.InvocationManagerImpl.preInvoke(InvocationManagerImpl.java:136)
        at com.sun.appserv.server.ServerLifecycleModule.preInvoke(ServerLifecycleModule.java:178)
        at com.sun.appserv.server.ServerLifecycleModule.postEvent(ServerLifecycleModule.java:219)
        at com.sun.appserv.server.ServerLifecycleModule.onShutdown(ServerLifecycleModule.java:273)
        at com.sun.appserv.server.LifecycleModuleService.onShutdown(LifecycleModuleService.java:487)
        at com.sun.enterprise.server.ApplicationServer.onShutdown(ApplicationServer.java:549)
        at com.sun.enterprise.server.ondemand.OnDemandServer.onShutdown(OnDemandServer.java:131)
        at com.sun.enterprise.server.PEMain.run(PEMain.java:427)
        at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
|#]

[#|2009-04-16T15:13:01.755-0400|INFO|sun-appserver9.1|ShoalLogger|_ThreadID=10;_ThreadName=main;soacluster;|Leaving GMS group soacluster with shutdown type set to InstanceShutdown|#]

[#|2009-04-16T15:13:02.858-0400|WARNING|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|CORE5061: Exception :
java.lang.NullPointerException
        at com.sun.enterprise.util.InvocationManagerImpl.preInvoke(InvocationManagerImpl.java:136)
        at com.sun.appserv.server.ServerLifecycleModule.preInvoke(ServerLifecycleModule.java:178)
        at com.sun.appserv.server.ServerLifecycleModule.postEvent(ServerLifecycleModule.java:219)
        at com.sun.appserv.server.ServerLifecycleModule.onTermination(ServerLifecycleModule.java:277)
        at com.sun.appserv.server.LifecycleModuleService.onTermination(LifecycleModuleService.java:496)
        at com.sun.enterprise.server.ApplicationServer.onTermination(ApplicationServer.java:587)
        at com.sun.enterprise.server.PEMain.run(PEMain.java:432)
        at com.sun.enterprise.server.PEMain.main(PEMain.java:336)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at com.sun.enterprise.server.PELaunch.main(PELaunch.java:412)
|#]

[#|2009-04-16T15:13:02.860-0400|SEVERE|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=10;_ThreadName=main;_RequestID=c52b0b9b-9e5c-4657-9013-3d0f209b50e1;|Server stopped due to Server startup failure.|#]

[#|2009-04-16T15:13:02.868-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=15;_ThreadName=Thread-1;|sending notification to server...soa07d-03|#]

[#|2009-04-16T15:13:02.880-0400|INFO|sun-appserver9.1|javax.enterprise.system.core|_ThreadID=15;_ThreadName=Thread-1;|Server shutdown complete.|#]
[Message sent by forum member 'prataphp' (prataphp)]

http://forums.java.net/jive/thread.jspa?messageID=342477