Page 1 of 1

output inconsistent in link collector

Posted: Thu Jul 01, 2010 7:49 am
by adams06
I am missing couple of rows in link collector

Here is the job design

Xfm1 ---> link collector ---> sequential file

used this options:

Enable row buffer
inter process
buffersize 128
timeout 600 seconds

Would appreciate help from anyone

Posted: Thu Jul 01, 2010 7:57 am
by chulett
It's an artifact of the row buffering. What's your goal here, what purpose does the Link Collector serve?

Posted: Thu Jul 01, 2010 8:43 am
by adams06
Xfm1 ---> link collector ---> sequential file

there are 8 links coming out of tranformer--> i am collecting all of them using link collector(all have the same metadata) This is where i am missing rows of data --> then writing into seq file

Posted: Thu Jul 01, 2010 9:33 am
by chulett
I don't recall... do you need to have buffering on for this stage? Does it help if you add another transformer between the collector and file stages? :?

Posted: Thu Jul 01, 2010 11:10 am
by ray.wurlod
Row buffering must be on if the Link Collector stage is used.