Switch Versus Transformer for splitting data
Posted: Fri Dec 08, 2006 8:56 am
I am having trouble loading a table because I run out of log space. While the DBA gets his a*se in gear I will split up the dataset into smaller chunks and load them that way.
I used @OUTROWNUM to break the data down in the transformer in the constraint i.e.
1st output link @OUTROWNUM <= 50000
2nd output link @OUTROWNUM > 50000 and @OUTROWNUM < 100000 etc but strangely enough it didn't work (am I being to Server-y in my approach). Is it due to node distribution ?
So I thought I would use the switch stage but I can't seem to use the @OUTROWNUM in the Case part
Any ideas at all ?
Thanks
I used @OUTROWNUM to break the data down in the transformer in the constraint i.e.
1st output link @OUTROWNUM <= 50000
2nd output link @OUTROWNUM > 50000 and @OUTROWNUM < 100000 etc but strangely enough it didn't work (am I being to Server-y in my approach). Is it due to node distribution ?
So I thought I would use the switch stage but I can't seem to use the @OUTROWNUM in the Case part
Any ideas at all ?
Thanks