Search found 27 matches

by ArjunK
Wed Dec 23, 2009 1:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to translate EDI X12 documents
Replies: 1
Views: 1869

I have done some EDI846 translations and as Chulett mentioned you will need to extract data by looking at the segments. Since, the entire document comes in a single line , first you can use the "segment delimiter" in the document and replace that with a newline "\n" to get each s...
by ArjunK
Fri Nov 06, 2009 11:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ - Post messages in a group
Replies: 6
Views: 1895

Thanks Guys. Since we are still on 7.5 , we went with the approach of passing a Unique Group Id along with the Message itself. Using that the consuming app is able to identify which XML chunks(messages) are linked to each other.
by ArjunK
Fri Oct 30, 2009 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Preventing tags from being written into an XML file
Replies: 6
Views: 1433

Based on the column value that you want to filter out, you can capture and transform it to an empty string in a transformer. Then in the XML output stage set the "Replace Empty values with NULL" property and that should prevent the tag from getting generated.
by ArjunK
Fri Oct 30, 2009 8:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ - Post messages in a group
Replies: 6
Views: 1895

Esentially we want to send chunks of XML messages to the consuming application , however, the application needs a way to know that all the messages are logiclly tied to each other (in a group). There is a concept of Group Id in MQ, but I am not sure if Datastage can send that with the actual XMl pay...
by ArjunK
Wed Oct 28, 2009 10:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ - Post messages in a group
Replies: 6
Views: 1895

MQ - Post messages in a group

Hi, Is it possible for Datastage to explicity post messages in a group using the MQ Plugin Stage. I looked around and wasnt able to find any options of doing that. The only reference to "Groupd Id" is avaialble while reading messages off the queue but nothing while writting them to the que...
by ArjunK
Tue May 06, 2008 11:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ 2024 Error
Replies: 5
Views: 4194

Hi Ernie, Yes, we are reading all the messages from the queue. Each message is a XML and our job flow is something like MQ-> XML Input -> Transformer - > Dataset Then we have downstream jobs which consume the dataset and load tables. We don't want to run our entire ETL flow with just 5000 records in...
by ArjunK
Mon May 05, 2008 10:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ commit/backout
Replies: 1
Views: 970

We have observed this issue happening only when we use a Folder Server Shared container in a parallel job.
Now we completely switched to a server job instead of using the shared container.
by ArjunK
Mon May 05, 2008 9:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ 2024 Error
Replies: 5
Views: 4194

MQ 2024 Error

Hi, We have a datastage process in place which reads messages off the queue for processing. We have the following properties set: Wait time=60 sec Message limit = 0 Destructive read with Commit/backout option checked In the Queue Manager , there is a property which limits the number of messages that...
by ArjunK
Thu Apr 03, 2008 2:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ commit/backout
Replies: 1
Views: 970

MQ commit/backout

Hi, We have a parallel job in which we are reading messages from MQ and writing to a file using the folder stage (server container). MQ -> transformer -> folder (server container) The Destructive read option is checked along with the Commit/backout only at the end of the job option. Still , we seein...
by ArjunK
Fri Mar 14, 2008 10:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Design Help - Reverse Pivot vs Running Sequential Mode
Replies: 4
Views: 1241

ArndW, Even if we set the commit frequency to 1 , with Oracle EE , won't it try to do a parallel update of mutiple records and if those records are updating the same database records it can still cause the deadlock. Isn't it possible that before one record gets committed , the other one tries to upd...
by ArjunK
Fri Mar 14, 2008 10:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Design Help - Reverse Pivot vs Running Sequential Mode
Replies: 4
Views: 1241

Design Help - Reverse Pivot vs Running Sequential Mode

Hi, We have a requirement where in for every column in the table we are getting a record in the input i.e. say there are 100 columns in the table , we are getting 100 records in the Input for a specific primary key column. Each record has a value of one column of the Table. Our database is Oracle , ...
by ArjunK
Wed Jan 30, 2008 10:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ - Subscribe to a Topic
Replies: 2
Views: 954

MQ - Subscribe to a Topic

Hi Folks,
Is it possible for the MQ Stage to Subscribe to a topic for reading the messages?

I went through the documentation and searched the site but couldn't find much information on this.

Thanks.