data store in data set

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Rajee
Participant
Posts: 46
Joined: Thu Mar 13, 2008 7:06 am
Location: India

data store in data set

Post by Rajee »

Hi,

Kindly clarify if there is any way to write only the key column value of the compared files to the first,second columns of the compare stage's output link instead of writing the whole record and also the method to read the data from data set.

Thx,
Rajee
bcarlson
Premium Member
Premium Member
Posts: 772
Joined: Fri Oct 01, 2004 3:06 pm
Location: Minnesota

Post by bcarlson »

If you want a dataset with just the keys, use a modify stage after your compare. Either specify DROP and list the columns to drop, or specify KEEP and list the columns to keep.

When you say 'read the data from data set', what do you want to do with it? We need more info.

Brad.
Rajee
Participant
Posts: 46
Joined: Thu Mar 13, 2008 7:06 am
Location: India

Post by Rajee »

bcarlson wrote:If you want a dataset with just the keys, use a modify stage after your compare. Either specify DROP and list the columns to drop, or specify KEEP and list the columns to keep.

When you say 'read the data from data set', what do you want to do with it? We need more info.

Brad.
I am comparing two flat files through compare stage and storing the result in the data set...later i need to use the data set to extract the key colums and log the discrepent records....
Nripendra Chand
Premium Member
Premium Member
Posts: 196
Joined: Tue Nov 23, 2004 11:50 pm
Location: Sydney (Australia)

Post by Nripendra Chand »

you can read only selected columns from dataset. there is no issue in that.
-Nripendra Chand
Rajee
Participant
Posts: 46
Joined: Thu Mar 13, 2008 7:06 am
Location: India

Post by Rajee »

Rajee wrote:
bcarlson wrote:If you want a dataset with just the keys, use a modify stage after your compare. Either specify DROP and list the columns to drop, or specify KEEP and list the columns to keep.

When you say 'read the data from data set', what do you want to do with it? We need more info.

Brad.
I am comparing two flat files through compare stage and storing the result in the data set...later i need to use the data set to extract the key colums and log the discrepent records....
The compare stage returns only 3 columns to the output link ie one is result,the other two are first and second in which the first column holds the entire record details of source 1 and the second holds the entire record of record 2.in such case how can i use modify stage.....
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You can first promote the two subrecords using Promote Subrecords stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply