Entire text file as a single Message to MQ

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
thumati.praveen
Participant
Posts: 106
Joined: Wed Oct 04, 2006 5:21 am

Entire text file as a single Message to MQ

Post by thumati.praveen »

Hi,

Can any one have done before the entire text file as a single message to MQ?If so, Please let me know what would be the option we have to set in MQ Connector stage.

Thanks In advance,
Praveen.
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

MQ isn't the issue as much as "getting the file" into a single column. I'd probably use a Server Job and then just have a Folder Stage pick up the file "as is" and send as a single large column (check out the Folder "Built-in" table definition for the column called Record) into the MQ Stage. I've done that for documents as large as 100M.

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
thumati.praveen
Participant
Posts: 106
Joined: Wed Oct 04, 2006 5:21 am

Post by thumati.praveen »

Thanks for the suggetion.Is there any way to do in parallel job?

Thanks Again,
Praveen.
eostic
Premium Member
Premium Member
Posts: 3838
Joined: Mon Oct 17, 2005 9:34 am

Post by eostic »

Not easily. The sequential stage cannot consistently pick up a "whole" file.....if it has variable length text with stray embedded CRLFs anywhere, it is likely to fail......and maybe not in test, but at some future time....

Ernie
Ernie Ostic

blogit!
<a href="https://dsrealtime.wordpress.com/2015/0 ... ere/">Open IGC is Here!</a>
Post Reply