Input and output row count

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Gopinath
Participant
Posts: 52
Joined: Wed Apr 25, 2007 2:18 am
Location: Chennai

Input and output row count

Post by Gopinath »

Hi,

I have two records in the input, while processing I split the first record into two. But in the output Im getting only 2 records which is the 1st record and the splitted record.Im not getting the 2nd record.

Is the input and output count should be same?

Is there any possibility of getting all the records at the output?

Please help me out.
Gopinath
mk_ds09
Participant
Posts: 72
Joined: Sun Jan 25, 2009 4:50 pm
Location: Pune

Post by mk_ds09 »

Can you give us more details?

Which stages you are using and how you are making 2 records of one record ?

There is no rule as such there should be same number of input and same number if output..otherwise row generater might not have worked at all :wink:
-----------------------------------
Regards
MK

What would you attempt to do if you knew you could not fail?

-----------------------------------
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Have a look in the director log for any messages.
Gopinath
Participant
Posts: 52
Joined: Wed Apr 25, 2007 2:18 am
Location: Chennai

Post by Gopinath »

mk_ds09 wrote:Can you give us more details?

Which stages you are using and how you are making 2 records of one record ?

There is no rule as such there should be same number of input and same number if output..otherwise row generater might not have worked at all :wink:
Actualy Im using 3 stages in the job: input datset -- Transformer-- Output dataset. I'm calculating a date in the transformer and check the same with another date, if condition is not met I have to split the record in the transformer and write it as two records.

Is there any possibility of doing this??
Gopinath
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

You need one more stage.

How did you split the row and write into the same output dataset?
mk_ds09
Participant
Posts: 72
Joined: Sun Jan 25, 2009 4:50 pm
Location: Pune

Post by mk_ds09 »

Try this design..

Seq file - > Transformer => funnel - > seq. file

From Transformer stage there will two output links. You can put constraint depending upon your requirement, so that two records will pass on the two links and funnel will collect those records and final sequential file will contain the two records..

hope this helps..
-----------------------------------
Regards
MK

What would you attempt to do if you knew you could not fail?

-----------------------------------
Post Reply