Page 1 of 1

Parallel execution of queries

Posted: Sun Jul 31, 2011 10:03 pm
by BalageBaju
Hi,

We have a set of queries in a table as follows. For example
Group ID SQL Query
1 Select * from table11
1 Select * from table12
1 Select * from table13
2 Select * from table21
2 Select * from table22
2 Select * from table23
2 Select * from table24
3 Select * from table31
3 Select * from table32

Currently, the job is looping through and reading the records from table one by one, executing it in Oracle database and loading the results into respective sequential files.

Now we want to execute the queries parallely based on the group ids. For example: suppose if I have 3 groups then one query should execute from each group parallely and then the next one from each group and so on...

Note: The no. of groups is static.

Please help me on implementing this using Datastage.

Thanks,
Balaji

Posted: Sun Jul 31, 2011 10:10 pm
by ray.wurlod
Multiple database stages. Funnel stage.