users@jersey.java.net

Re: [Jersey] Re: using jaxb to stream a large data set

From: Paul Sandoz <Paul.Sandoz_at_oracle.com>
Date: Wed, 18 Aug 2010 11:11:26 +0200

On Aug 17, 2010, at 9:02 PM, bmraczk wrote:

>
> I am sorry Paul for not getting back to you quicker. I missed typed
> the size
> of the data. We can pass between 10 and 100 m of data.

OK.


> The data in
> uniformed and it is really aggregate from a huge data store. I was
> thinking of zipping the response.

Yes gzip'ing will definitely help in terms of network transmission
efficiency. For repetitive XML data GZIP can do a good job.


> Can I use a MessageWriter to help chunk
> the xml data.

Yes, or StreamingOutput if you want to keep things closer to your
application code.


> If I stream the XML data does that not effect the way the
> client reads the data?

No, the client will not know as it is a server-side implementation
detail. Of course you will need to document to your clients the type
of data and expectations as i would presume that some clients
processing the response will need to process it chunks rather than
buffering it all in memory.

Paul.