Well then it seems that my app server and jpa provider does not follow the spec since I am able to catch the runtime exceptions without getting a rollback?
I guess I have to go through the spec in more detail...
[Message sent by forum member 'woel' (woel)]
http://forums.java.net/jive/thread.jspa?messageID=268490