My job design looks like this
Code: Select all
externalsourcestage--->transformer---sequential file.
sample1.txt
100
sample2.txt
150
..
.
In the transformer I am deriving filename by the below expression in stage variable.
index(DSLink31.read,".txt",1)<>0 then DSLink31.read else svfilename
In the derivation im using this stage variable as filename.My output derivation looks like below.
DSLink31.read ---data
svfilename ----filename.
Constraint
index(DSLink31.read,".txt",1)=0
When i run the job with varchar data the job runs fine.
But when i run the job with data as above in the output the filename does not get populated in the sequential file.
Both column datatypes and stagevariable datatype i have maintained as Varchar.
The job runs succesfully if transformer is made to run sequentially.
So is there a problem with partioning of data?
Thanks,
Chetan.C