Segmented message reading

mary · Post by **mary** » Wed Dec 31, 2008 12:10 am

Hi All

We have a requirement to read messages from the message queue in jobs. Since our file is very larget the single file will be coming in multiple files. At a time we have to process messages corresponds to single messages. Is there a way to distinguish the messages from one group in message queue read stage?

Thanks in advance.

ray.wurlod · Post by **ray.wurlod** » Wed Dec 31, 2008 12:26 am

Message headers, presumably. What does the application that is writing to the queue do to identify whole file versus part file message?

mary · Post by **mary** » Wed Dec 31, 2008 1:17 am

From Group id we can identify.

ray.wurlod · Post by **ray.wurlod** » Wed Dec 31, 2008 3:00 am

Accumulate the entire message in a Transformer stage, follow with an Aggregator stage that passes only the Last in each group (message ID).