users@jaxb.java.net

RE: Processing Large XML Files

From: Volkmann, Mark <Mark.Volkmann_at_AGEDWARDS.com>
Date: Mon, 3 Nov 2003 09:29:43 -0600

> -----Original Message-----
> From: Kohsuke Kawaguchi [mailto:Kohsuke.Kawaguchi_at_Sun.COM]
> Sent: Monday, November 03, 2003 9:24 AM
> To: users_at_jaxb.dev.java.net
> Subject: Re: Processing Large XML Files
>
>
>
> > I love XML, but 60GB is well beyond what I feel is its
> limit when reasonable
> > performance is important. I think you should consider not
> using XML for
> > data of this size.
>
> I'm not sure how not using XML would solve the problem in any way. You
> just have to tweak the processing model, and it doesn't matter if your
> format is XML or CSV or a custom binary format.

I'm assuming that the 60GB of XML would be significantly smaller if it were
in a binary format and that many non-XML formats can be parsed more quickly
than XML. Aren't these reasonable assumptions?

That said, you'd have to look pretty hard to find a bigger proponent of XML
than me. ;-)


------------------------------------------------------------------------------------------
A.G. Edwards & Sons' outgoing and incoming e-mails are electronically
archived and subject to review and/or disclosure to someone other
than the recipient.

------------------------------------------------------------------------------------------