output inconsistent in link collector

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
adams06
Participant
Posts: 92
Joined: Sun Mar 12, 2006 3:00 pm

output inconsistent in link collector

Post by adams06 »

I am missing couple of rows in link collector

Here is the job design

Xfm1 ---> link collector ---> sequential file

used this options:

Enable row buffer
inter process
buffersize 128
timeout 600 seconds

Would appreciate help from anyone
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

It's an artifact of the row buffering. What's your goal here, what purpose does the Link Collector serve?
-craig

"You can never have too many knives" -- Logan Nine Fingers
adams06
Participant
Posts: 92
Joined: Sun Mar 12, 2006 3:00 pm

Post by adams06 »

Xfm1 ---> link collector ---> sequential file

there are 8 links coming out of tranformer--> i am collecting all of them using link collector(all have the same metadata) This is where i am missing rows of data --> then writing into seq file
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I don't recall... do you need to have buffering on for this stage? Does it help if you add another transformer between the collector and file stages? :?
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Row buffering must be on if the Link Collector stage is used.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply