Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.
Moderators: chulett , rschirm , roy
adams06
Participant
Posts: 92 Joined: Sun Mar 12, 2006 3:00 pm
Post
by adams06 » Thu Jul 01, 2010 7:49 am
I am missing couple of rows in link collector
Here is the job design
Xfm1 ---> link collector ---> sequential file
used this options:
Enable row buffer
inter process
buffersize 128
timeout 600 seconds
Would appreciate help from anyone
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Thu Jul 01, 2010 7:57 am
It's an artifact of the row buffering. What's your goal here, what purpose does the Link Collector serve?
-craig
"You can never have too many knives" -- Logan Nine Fingers
adams06
Participant
Posts: 92 Joined: Sun Mar 12, 2006 3:00 pm
Post
by adams06 » Thu Jul 01, 2010 8:43 am
Xfm1 ---> link collector ---> sequential file
there are 8 links coming out of tranformer--> i am collecting all of them using link collector(all have the same metadata) This is where i am missing rows of data --> then writing into seq file
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Thu Jul 01, 2010 9:33 am
I don't recall... do you
need to have buffering on for this stage? Does it help if you add another transformer between the collector and file stages?
-craig
"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607 Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:
Post
by ray.wurlod » Thu Jul 01, 2010 11:10 am
Row buffering must be on if the Link Collector stage is used.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.