@INROWNUM and @PARTITIONNUM

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
bi_fujitsu
Premium Member
Premium Member
Posts: 46
Joined: Tue Mar 20, 2007 3:30 am
Location: India

@INROWNUM and @PARTITIONNUM

Post by bi_fujitsu »

We have a scenario, wherein we have 8-9 source datasets. After each dataset we have a transformer in which table_name is hardcoded. this transformer has only one column--table_name.
We are checking that if any of the dataset is having data, then that particular table_name (from transformer) is being written to the target dataset. The constraint in the transformer is '@INROWNUM=1 and @PARTITIONNUM=0'. We do have 2-node configuration file.
The problem here is, some of the datasets are working fine, but in 1-2 datasets, even if they have got data, nothing is going beyond transformer.
If anyone came across similar problem, please respond...
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What a strange design! What the constraint means is that, if the table name is allocated to partition #1, it will never make it to the output. I suspect that's not what you want.

Forget DataStage for the moment.

Write out a specification (in English) describing your source data, what the target needs to look like, and the business rules that determine how rows get from source to target.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
bi_fujitsu
Premium Member
Premium Member
Posts: 46
Joined: Tue Mar 20, 2007 3:30 am
Location: India

Post by bi_fujitsu »

The scenario is, if any data exist in any of the datasets, the corresponding hardcoded value (in transformer) has to be captured in the target file. This target file will be used to run the job having that hardcoded value in its name.

The above design is fixed across various projects and is working for other projects.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

So what's different about this project?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply