DSXchange

all the records in the 3 files are combined ,read in parallel, processed by downstream stage

What's the point of asking a question & editing it

You can include filename property ( which gets enables when you use file pattern ) & make sure that you are setting that env variable as suggested by sura

jcook wrote:Can you explain why you would want to do partitioned reads from a non-partitioned table?

I guess to read the data in parallel & make it fast

The files will be processed one by one in case of file pattern method. But,he wants to process all the files in parallel. I believe using a file pattern & reading more than 1 file process the data in parallel . If there are 5 files all those are read in parallel & pass to the down stream st...

I have worked in both datastage & abinitio . In my opinion , Abinitio has some powerful features which are missing in datastage . In abinitio , We have a functionality of disabling & conditional execution of the components ( Stages ) . This feature is helpful while performing some testing &a...

You need to make sure that partitioning of data takes before the sorting of data ...

You need to make sure that C++ compiler is installed on the server & you are specifying the values of those env variable correctly .There are zillions of posts related to this issue ..Make a search & you would get to know the solution .

It's not clear ..Please explain in detail ..What do you mean by value set ? Is it value file in parameter set ??

I think Running 52 instances of same job parallely is a too much load on the server ...I think it's not a bad idea to have 10 connector stages & union 5 tables in each connector stage ..Also there used to be a limitation of number of instances of job running in parallel in 8.0.1 ..Not so sure if...

I think you can try with ceil & mod functions .

Failing means what ? What exactly is the error message you are getting in case of no redirection into log & error files . Ideally 1>logfile 2>errorfile should redirect standard o/p into logfile & standard error into errorfile .

Use aggregator stage & use the option preserve datatype to get the o/p datatype in date or you can also use stage variables in a transformer stage to get the min value..

Option 1 : Use single oracle enterprise stage & use the single UNION query to get all the data from 52 tables Option 2: Use 52 oracle entegerprise stages & use a funnel to union the data . If the you are having a restriction of number of stages , Use union of 5 tables & it will end up in...

You can control it by including APT_CONFIG_FILE in your job parameter .