Parallel execution of queries
Posted: Sun Jul 31, 2011 10:03 pm
Hi,
We have a set of queries in a table as follows. For example
Group ID SQL Query
1 Select * from table11
1 Select * from table12
1 Select * from table13
2 Select * from table21
2 Select * from table22
2 Select * from table23
2 Select * from table24
3 Select * from table31
3 Select * from table32
Currently, the job is looping through and reading the records from table one by one, executing it in Oracle database and loading the results into respective sequential files.
Now we want to execute the queries parallely based on the group ids. For example: suppose if I have 3 groups then one query should execute from each group parallely and then the next one from each group and so on...
Note: The no. of groups is static.
Please help me on implementing this using Datastage.
Thanks,
Balaji
We have a set of queries in a table as follows. For example
Group ID SQL Query
1 Select * from table11
1 Select * from table12
1 Select * from table13
2 Select * from table21
2 Select * from table22
2 Select * from table23
2 Select * from table24
3 Select * from table31
3 Select * from table32
Currently, the job is looping through and reading the records from table one by one, executing it in Oracle database and loading the results into respective sequential files.
Now we want to execute the queries parallely based on the group ids. For example: suppose if I have 3 groups then one query should execute from each group parallely and then the next one from each group and so on...
Note: The no. of groups is static.
Please help me on implementing this using Datastage.
Thanks,
Balaji