Hi
We have jobs ,Where we need to LookUp on either DataSets or LookUpFileSets.And data to be processed is more than 40 lakhs
Which would be better Data Sets or Look Up FileSets.PLease suggest and why?
DataSet/LookUpFileSet
-
- Participant
- Posts: 64
- Joined: Wed Sep 26, 2007 6:52 am
- Location: Syracuse ,NY
DataSet/LookUpFileSet
Althaf
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
There's nothing in QualityStage that requires the use of these. But you have posted in the QualityStage forum.
I accept that DataStage and QualityStage shared the same Designer in version 8, but QualityStage does not perform lookups using the stage types you have nominated.
I accept that DataStage and QualityStage shared the same Designer in version 8, but QualityStage does not perform lookups using the stage types you have nominated.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Re: DataSet/LookUpFileSet
Hi,Althaf6553 wrote:Hi
We have jobs ,Where we need to LookUp on either DataSets or LookUpFileSets.And data to be processed is more than 40 lakhs
Which would be better Data Sets or Look Up FileSets.PLease suggest and why?
As Per My knowledge cosider U can go use LookupFile Set. Because u mention data as 40 lacks data if you have that much data u can use LookupFile set. If you want use dataset that can give less performence.
Regards,
LV
Raji
-
- Participant
- Posts: 467
- Joined: Tue Mar 20, 2007 6:36 am
- Location: Chennai
- Contact:
Re: DataSet/LookUpFileSet
If I had to choose between Lookup fileset and a Dataset, the first thing I would see was the number of times this data is being used for reference. If it's being used in more than one place for lookups, I would go with the Lookup fileset, else I wouldn't bother creating Lookup filesets.Althaf6553 wrote:Hi
We have jobs ,Where we need to LookUp on either DataSets or LookUpFileSets.And data to be processed is more than 40 lakhs
Which would be better Data Sets or Look Up FileSets.PLease suggest and why?
But, again using a lookup is altogether a different thing. If I had 4 Million records for input, I may have not gone with a lookup at all. But, it all depends on the resources available, the input data etc,.
Minhajuddin
<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
I still fail to see the relevance to QualityStage or, for that matter, to U (one of our occasional posters).
The second person personal pronoun in English is spelled "you", not "u".
The second person personal pronoun in English is spelled "you", not "u".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
- Participant
- Posts: 467
- Joined: Tue Mar 20, 2007 6:36 am
- Location: Chennai
- Contact:
Ray, I think the OP has put the post in the wrong forum, It is supposed to be in Datastage Parallel forum.
Minhajuddin
<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>