Hi,
I have data in a source table. I want to group the data based on a field.
Should I use SQL query inside my source table stage or shall I use an agreegator stage. Which one is a better option and why?
Thanks in advance .
SQL query or explicit stage
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 38
- Joined: Tue Jun 19, 2012 11:03 pm
- Location: India
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
-
- Premium Member
- Posts: 38
- Joined: Tue Jun 19, 2012 11:03 pm
- Location: India
In stage query or explicit stage
Hi Ray,
There's no indexing in the table.
Right now, sample data I have has very low number of records so I am not able to find out any difference in time by both the methods.
But in production, there would be huge amount of data and that's why I want to know which one would work better?
There's no indexing in the table.
Right now, sample data I have has very low number of records so I am not able to find out any difference in time by both the methods.
But in production, there would be huge amount of data and that's why I want to know which one would work better?
It is almost impossible to answer this question not knowing the particular task and data.
If SQL-grouping will reduce the number of records selected drastically and the database is not too weak on resources, I would probably opt for that. If not I would expect DataStage to be faster in many circumstances.
But as KrytOn said: the answer depends on many factors...
If SQL-grouping will reduce the number of records selected drastically and the database is not too weak on resources, I would probably opt for that. If not I would expect DataStage to be faster in many circumstances.
But as KrytOn said: the answer depends on many factors...
"It is not the lucky ones are grateful.
There are the grateful those are happy." Francis Bacon
There are the grateful those are happy." Francis Bacon