DataSet/LookUpFileSet

Infosphere's Quality Product

Moderators: chulett, rschirm

Post Reply
Althaf6553
Participant
Posts: 64
Joined: Wed Sep 26, 2007 6:52 am
Location: Syracuse ,NY

DataSet/LookUpFileSet

Post by Althaf6553 »

Hi

We have jobs ,Where we need to LookUp on either DataSets or LookUpFileSets.And data to be processed is more than 40 lakhs
Which would be better Data Sets or Look Up FileSets.PLease suggest and why?
Althaf
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There's nothing in QualityStage that requires the use of these. But you have posted in the QualityStage forum.

I accept that DataStage and QualityStage shared the same Designer in version 8, but QualityStage does not perform lookups using the stage types you have nominated.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
lvraji
Participant
Posts: 3
Joined: Tue Jun 10, 2008 3:32 am
Location: Hyderabad

Re: DataSet/LookUpFileSet

Post by lvraji »

Althaf6553 wrote:Hi

We have jobs ,Where we need to LookUp on either DataSets or LookUpFileSets.And data to be processed is more than 40 lakhs
Which would be better Data Sets or Look Up FileSets.PLease suggest and why?
Hi,

As Per My knowledge cosider U can go use LookupFile Set. Because u mention data as 40 lacks data if you have that much data u can use LookupFile set. If you want use dataset that can give less performence.

Regards,
LV
Raji
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Re: DataSet/LookUpFileSet

Post by Minhajuddin »

Althaf6553 wrote:Hi

We have jobs ,Where we need to LookUp on either DataSets or LookUpFileSets.And data to be processed is more than 40 lakhs
Which would be better Data Sets or Look Up FileSets.PLease suggest and why?
If I had to choose between Lookup fileset and a Dataset, the first thing I would see was the number of times this data is being used for reference. If it's being used in more than one place for lookups, I would go with the Lookup fileset, else I wouldn't bother creating Lookup filesets.

But, again using a lookup is altogether a different thing. If I had 4 Million records for input, I may have not gone with a lookup at all. But, it all depends on the resources available, the input data etc,.
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I still fail to see the relevance to QualityStage or, for that matter, to U (one of our occasional posters).

The second person personal pronoun in English is spelled "you", not "u".
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Minhajuddin
Participant
Posts: 467
Joined: Tue Mar 20, 2007 6:36 am
Location: Chennai
Contact:

Post by Minhajuddin »

Ray, I think the OP has put the post in the wrong forum, It is supposed to be in Datastage Parallel forum.
Minhajuddin

<a href="http://feeds.feedburner.com/~r/MyExperi ... ~6/2"><img src="http://feeds.feedburner.com/MyExperienc ... lrow.3.gif" alt="My experiences with this DLROW" border="0"></a>
Post Reply