Search found 87 matches

by Das
Thu Jul 05, 2007 11:59 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

ray.wurlod wrote:Does a VOC pointer exist for MyHashFileName ?

It's hashed file, by the way, not hash file. ...
Thanks a lot.
I dont have any idea about VOC pointer
Could you tell how i can check that.
by Das
Thu Jul 05, 2007 8:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

Das, in order to store appreciably more than 2Gb in a hashed file you will, as you have already presumed, need to create a 64bit file. This cannot be done via the graphical front end, you will need ... I have used RESIZE MyHashFileName * * * 64BIT USING /ABC/PQR/InputDir in DS Admistrator command B...
by Das
Thu Jul 05, 2007 8:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

Das, in order to store appreciably more than 2Gb in a hashed file you will, as you have already presumed, need to create a 64bit file. This cannot be done via the graphical front end, you will need ... I have used RESIZE MyHashFileName * * * 64BIT USING /ABC/PQR/InputDir in DS Admistrator command B...
by Das
Thu Jul 05, 2007 8:22 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

Das, in order to store appreciably more than 2Gb in a hashed file you will, as you have already presumed, need to create a 64bit file. This cannot be done via the graphical front end, you will need ... I have used RESIZE MyHashFileName * * * 64BIT USING /ABC/PQR/InputDir in DS Admistrator command B...
by Das
Thu Jul 05, 2007 7:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

Could you expalain this process?How we can create the 64 bit hash file internally
by Das
Thu Jul 05, 2007 7:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

ArndW wrote:Das,

in order to store appreciably more than 2Gb in a hashed file you will, as you have already presumed, need to create a 64bit file. This cannot be done via the graphical front end, you will need ...
Could you expalain this process?How we can create the 64 bit hash file internally
by Das
Thu Jul 05, 2007 7:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

ArndW wrote:Das,

in order to store appreciably more than 2Gb in a hashed file you will, as you have already presumed, need to create a 64bit file. This cannot be done via the graphical front end, you will need ...
Could you expalain this process?How we can create the 64 bit hash file internally
by Das
Wed Jul 04, 2007 4:04 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creating 64 bit hash file
Replies: 23
Views: 6693

Creating 64 bit hash file

Hi All, I wanted to create a Hashfile which can handle more than 4GB of data for look up pupose.Currently we are using 32 bit [default]hash file which can handle only upto 2GB of data .So for handing more data i think i should to create 64 bit hash file Plese give me your valuble suggestions in this...
by Das
Thu May 31, 2007 4:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Performing Lookups on Large tables
Replies: 4
Views: 1635

Performing Lookups on Large tables

Hi ,

I wanted to do a self join with a table which it is having data around 10 crores of rows. ,Which is the best method to do that.

Please suggest..
Thanks in advance..
by Das
Thu Apr 26, 2007 7:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem with Aggretaor
Replies: 10
Views: 2753

The error is pretty self-explanatory. You've told the Aggregator to expect rows in a certain order and it found a row 'out of sequence' - one that violated your alleged order. Correct it. I have used the same order from tranformer which populate data to aggragator Transformer col1 col2 Aggragator i...
by Das
Thu Apr 26, 2007 7:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem with Aggretaor
Replies: 10
Views: 2753

We keep advising you to use sorted data. 30 million rows is not too many. Even a UNIX sort can manage this many. The Aggregator stage with unsorted input will almost always abort with this much data, ... Thanks for the information. Some of my tables contains 30 crores of rows .I have used the sort ...
by Das
Thu Apr 26, 2007 12:51 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem with Aggretaor
Replies: 10
Views: 2753

chulett wrote:What's your volume? As noted, I'lll wager you need to sort your data and then assert that in the stage. ...
3-6 crores rows of data.No soring i have used.
by Das
Thu Apr 26, 2007 12:49 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem with Aggretaor
Replies: 10
Views: 2753

Do you have sorted input? Can you explain your job design a little bit more clearly. Do you have any more error messages? details man details. No other error messeges,Data Volume is 3 crores of rows. From input informix stage ,I am using simpe simple SQL Stament Select col1,col2 From tab1 Then pass...
by Das
Wed Apr 25, 2007 4:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Problem with Aggretaor
Replies: 10
Views: 2753

Problem with Aggretaor

Hi,
When i am using the transformer i am getting the follwing error in director
Abnormal termination of stage ABCD..Aggregator_11 detected

I am taking two columns col1 and col2 from the source and in aggregator
group by col1 and max(col2)

passing the same to u/p file

Please help me out.
by Das
Tue Apr 24, 2007 1:21 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Look up based on two conditions
Replies: 9
Views: 2958

Thanks, I have used two hashed file lookups,And use the following logic in output column of transformer : If not(IsNull(DSLink86.Col1)) then Unit_Out.Col1 Else if not(IsNull(DSLink89.Col1)) then DSLink89.Col1 else @NULL DSLink86.Col1,DSLink89.Col1 are input links from lookups populating based on the...