users@glassfish.java.net

(AbstractResourcePool locks all Threads) Re: Maximum Connections Reached: 4096 -- Retry later

From: Jeanfrancois Arcand <Jeanfrancois.Arcand_at_Sun.COM>
Date: Tue, 03 Mar 2009 13:53:16 -0500

Salut,

again locked on connector/jdbc connection. Jagadish/Binod, any
recommendations:

> Thread t_at_1142: (state = BLOCKED)
> - com.sun.enterprise.resource.AbstractResourcePool.getResourceFromPool(com.sun.enterprise.resource.ResourceSpec, com.sun.enterprise.resource.ResourceAllocator, javax.transaction.Transaction) @bci=0, line=752 (Interpreted frame)
> - com.sun.enterprise.resource.AbstractResourcePool.getUnenlistedResource(com.sun.enterprise.resource.ResourceSpec, com.sun.enterprise.resource.ResourceAllocator, javax.transaction.Transaction) @bci=4, line=652 (Interpreted frame)
> - com.sun.enterprise.resource.AbstractResourcePool.internalGetResource(com.sun.enterprise.resource.ResourceSpec, com.sun.enterprise.resource.ResourceAllocator, javax.transaction.Transaction) @bci=309, line=594 (Interpreted frame)
> - com.sun.enterprise.resource.AbstractResourcePool.getResource(com.sun.enterprise.resource.ResourceSpec, com.sun.enterprise.resource.ResourceAllocator, javax.transaction.Transaction) @bci=37, line=443 (Interpreted frame)
> - com.sun.enterprise.resource.PoolManagerImpl.getResourceFromPool(com.sun.enterprise.resource.ResourceSpec, com.sun.enterprise.resource.ResourceAllocator, com.sun.enterprise.resource.ClientSecurityInfo, javax.transaction.Transaction) @bci=16, line=248 (Interpreted frame)
> - com.sun.enterprise.resource.PoolManagerImpl.getResource(com.sun.enterprise.resource.ResourceSpec, com.sun.enterprise.resource.ResourceAllocator, com.sun.enterprise.resource.ClientSecurityInfo) @bci=34, line=176 (Interpreted frame)
> - com.sun.enterprise.connectors.ConnectionManagerImpl.internalGetConnection(javax.resource.spi.ManagedConnectionFactory, com.sun.enterprise.deployment.ResourcePrincipal, javax.resource.spi.ConnectionRequestInfo, boolean, java.lang.String, java.lang.Object, boolean) @bci=453, line=337 (Interpreted frame)
> - com.sun.enterprise.connectors.ConnectionManagerImpl.allocateConnection(javax.resource.spi.ManagedConnectionFactory, javax.resource.spi.ConnectionRequestInfo, java.lang.String, java.lang.Object) @bci=83, line=189 (Interpreted frame)
> - com.sun.enterprise.connectors.ConnectionManagerImpl.allocateConnection(javax.resource.spi.ManagedConnectionFactory, javax.resource.spi.ConnectionRequestInfo, java.lang.String) @bci=5, line=165 (Interpreted frame)
> - com.sun.enterprise.connectors.ConnectionManagerImpl.allocateConnection(javax.resource.spi.ManagedConnectionFactory, javax.resource.spi.ConnectionRequestInfo) @bci=7, line=158 (Interpreted frame)
> - com.sun.gjc.spi.base.DataSource.getConnection() @bci=9, line=108 (Interpreted frame)
> - com.biperf.verizon.core.dao.JdbcDaoImpl.getConnection() @bci=14, line=97 (Interpreted frame)
> - com.biperf.verizon.legacy.dao.impl.LogonDAOImpl.logonAttempt(java.lang.String, java.lang.String, java.lang.String, boolean) @bci=129, line=100 (Interpreted frame)
> - sun.reflect.GeneratedMethodAccessor383.invoke(java.lang.Object, java.lang.Object[]) @bci=87 (Interpreted frame)
> - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=25 (Compiled frame)
> - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=161, line=597 (Compiled frame)
> - org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=7, line=310 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint() @bci=12, line=182 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=19, line=149 (Interpreted frame)
> - com.biperf.verizon.core.aop.PerformanceMonitorAndLoggingInterceptor.invoke(org.aopalliance.intercept.MethodInvocation) @bci=137, line=134 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=171 (Interpreted frame)
> - org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(org.aopalliance.intercept.MethodInvocation) @bci=15, line=89 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=171 (Interpreted frame)
> - org.springframework.aop.framework.JdkDynamicAopProxy.invoke(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=359, line=204 (Interpreted frame)
> - $Proxy117.logonAttempt(java.lang.String, java.lang.String, java.lang.String, boolean) @bci=32 (Interpreted frame)
> - com.biperf.verizon.legacy.service.impl.LogonServiceImpl.logonAttempt(java.lang.String, java.lang.String, java.lang.String, boolean) @bci=12, line=204 (Interpreted frame)
> - sun.reflect.GeneratedMethodAccessor382.invoke(java.lang.Object, java.lang.Object[]) @bci=87 (Interpreted frame)
> - sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object, java.lang.Object[]) @bci=6, line=25 (Compiled frame)
> - java.lang.reflect.Method.invoke(java.lang.Object, java.lang.Object[]) @bci=161, line=597 (Compiled frame)
> - org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=7, line=310 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint() @bci=12, line=182 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=19, line=149 (Interpreted frame)
> - com.biperf.verizon.core.aop.PerformanceMonitorAndLoggingInterceptor.invoke(org.aopalliance.intercept.MethodInvocation) @bci=137, line=134 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=171 (Interpreted frame)
> - org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(org.aopalliance.intercept.MethodInvocation) @bci=15, line=89 (Interpreted frame)
> - org.springframework.aop.framework.ReflectiveMethodInvocation.proceed() @bci=101, line=171 (Interpreted frame)
> - org.springframework.aop.framework.JdkDynamicAopProxy.invoke(java.lang.Object, java.lang.reflect.Method, java.lang.Object[]) @bci=359, line=204 (Interpreted frame)
> - $Proxy188.logonAttempt(java.lang.String, java.lang.String, java.lang.String, boolean) @bci=32 (Interpreted frame)
> - com.biperf.verizon.security.auth.CustomPasswordEncoder.isPasswordValid(java.lang.String, java.lang.String, java.lang.Object) @bci=75, line=85 (Interpreted frame)
> - org.springframework.security.providers.dao.DaoAuthenticationProvider.additionalAuthenticationChecks(org.springframework.security.userdetails.UserDetails, org.springframework.security.providers.UsernamePasswordAuthenticationToken) @bci=80, line=67 (Interpreted frame)
> - org.springframework.security.providers.dao.AbstractUserDetailsAuthenticationProvider.authenticate(org.springframework.security.Authentication) @bci=148, line=137 (Interpreted frame)
> - org.springframework.security.providers.ProviderManager.doAuthentication(org.springframework.security.Authentication) @bci=89, line=195 (Interpreted frame)
> - org.springframework.security.AbstractAuthenticationManager.authenticate(org.springframework.security.Authentication) @bci=2, line=46 (Interpreted frame)
> - org.springframework.security.ui.webapp.AuthenticationProcessingFilter.attemptAuthentication(javax.servlet.http.HttpServletRequest) @bci=93, line=82 (Interpreted frame)
> - org.springframework.security.ui.AbstractProcessingFilter.doFilterHttp(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, javax.servlet.FilterChain) @bci=40, line=252 (Interpreted frame)
> - org.springframework.security.ui.SpringSecurityFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=53 (Interpreted frame)
> - org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=371 (Interpreted frame)
> - org.springframework.security.ui.logout.LogoutFilter.doFilterHttp(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, javax.servlet.FilterChain) @bci=120, line=89 (Interpreted frame)
> - org.springframework.security.ui.SpringSecurityFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=53 (Interpreted frame)
> - org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=371 (Interpreted frame)
> - org.springframework.security.context.HttpSessionContextIntegrationFilter.doFilterHttp(javax.servlet.http.HttpServletRequest, javax.servlet.http.HttpServletResponse, javax.servlet.FilterChain) @bci=180, line=235 (Interpreted frame)
> - org.springframework.security.ui.SpringSecurityFilter.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=44, line=53 (Interpreted frame)
> - org.springframework.security.util.FilterChainProxy$VirtualFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=192, line=371 (Interpreted frame)
> - org.springframework.security.util.FilterChainProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=125, line=174 (Interpreted frame)
> - org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(javax.servlet.Filter, javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=5, line=183 (Interpreted frame)
> - org.springframework.web.filter.DelegatingFilterProxy.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse, javax.servlet.FilterChain) @bci=34, line=138 (Interpreted frame)
> - org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=120, line=230 (Interpreted frame)
> - org.apache.catalina.core.ApplicationFilterChain.access$000(org.apache.catalina.core.ApplicationFilterChain, javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=3, line=75 (Interpreted frame)
> - org.apache.catalina.core.ApplicationFilterChain$1.run() @bci=12, line=181 (Interpreted frame)
> - java.security.AccessController.doPrivileged(java.security.PrivilegedExceptionAction) @bci=0 (Interpreted frame)
> - org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest, javax.servlet.ServletResponse) @bci=22, line=177 (Interpreted frame)
> - org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=604, line=288 (Interpreted frame)
> - org.apache.catalina.core.StandardContextValve.invokeInternal(org.apache.catalina.Wrapper, org.apache.catalina.Request, org.apache.catalina.Response) @bci=248, line=271 (Interpreted frame)
> - org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=261, line=202 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.doInvoke(org.apache.catalina.Request, org.apache.catalina.Response, boolean) @bci=141, line=632 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.doInvoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=4, line=577 (Interpreted frame)
> - com.sun.enterprise.web.WebPipeline.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=87, line=94 (Interpreted frame)
> - org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=98, line=206 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.doInvoke(org.apache.catalina.Request, org.apache.catalina.Response, boolean) @bci=141, line=632 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.doInvoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=4, line=577 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=3, line=571 (Interpreted frame)
> - org.apache.catalina.core.ContainerBase.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=6, line=1080 (Interpreted frame)
> - org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=58, line=150 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.doInvoke(org.apache.catalina.Request, org.apache.catalina.Response, boolean) @bci=141, line=632 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.doInvoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=4, line=577 (Interpreted frame)
> - org.apache.catalina.core.StandardPipeline.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=3, line=571 (Interpreted frame)
> - org.apache.catalina.core.ContainerBase.invoke(org.apache.catalina.Request, org.apache.catalina.Response) @bci=6, line=1080 (Interpreted frame)
> - org.apache.coyote.tomcat5.CoyoteAdapter.service(org.apache.coyote.Request, org.apache.coyote.Response) @bci=307, line=272 (Interpreted frame)
> - com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.invokeAdapter() @bci=19, line=637 (Interpreted frame)
> - com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.doProcess(java.io.InputStream, java.io.OutputStream) @bci=15, line=568 (Interpreted frame)
> - com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.process(java.io.InputStream, java.io.OutputStream) @bci=9, line=813 (Interpreted frame)
> - com.sun.enterprise.web.connector.grizzly.DefaultReadTask.executeProcessorTask() @bci=86, line=341 (Interpreted frame)
> - com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(java.nio.ByteBuffer) @bci=168, line=263 (Interpreted frame)
> - com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask() @bci=76, line=214 (Interpreted frame)
> - com.sun.enterprise.web.portunif.PortUnificationPipeline$PUTask.doTask() @bci=760, line=380 (Compiled frame)
> - com.sun.enterprise.web.connector.grizzly.TaskBase.run() @bci=1, line=265 (Interpreted frame)
> - com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run() @bci=39, line=106 (Compiled frame)

A+

-- Jeanfrancois

glassfish_at_javadesktop.org wrote:
> The problem just occurred again and we took a jstack (attached).
>
> The database itself isn't showing locking though. Also, this is happening on only one server in the cluster. If it was the database, it should back up both servers in the cluster.
> [Message sent by forum member 'davideagen' (davideagen)]
>
> http://forums.java.net/jive/thread.jspa?messageID=334877
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe_at_glassfish.dev.java.net
> For additional commands, e-mail: users-help_at_glassfish.dev.java.net
>