Looks like increasing the PermGen memory size fixed this issue.
I'm using now -XX:MaxPermSize=512m and this ClassLoader issue seems to be gone, I've also changed the -Xmx switch.
[Message sent by forum member 'korneljan' (korneljan)]
http://forums.java.net/jive/thread.jspa?messageID=344633