Search found 99 matches

by kumarjit
Mon Nov 12, 2012 12:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: JOIN STAGE takes hell lot of time
Replies: 6
Views: 4574

JOIN STAGE takes hell lot of time

I have created a datastage job which takes around 5 MILLION records as input . One of the columns of this dataset is ADDRESS_ID (Varchar type, max length 100 chars). In the later stages of the job, there is a join stage which joins the input data with another reference dataset ( of comparable data v...
by kumarjit
Thu Nov 01, 2012 8:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to know the basics of working with Loops in Transformer
Replies: 6
Views: 4175

Re: Need to know the basics of working with Loops in Transfo

I had a couple of questions . 1. Is the loop executed ahead of the evaluation of the stage vairables,for a single input record ? 2. The Stage Variable NumSavedRows cannot be set to SaveInputRecord() because a correponding GetSavedInputRecord() needs to invoked , and that too within a loop variable ....
by kumarjit
Wed Oct 31, 2012 12:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to know the basics of working with Loops in Transformer
Replies: 6
Views: 4175

Hi there, Thanks for responding ..... There are lots of stuffs related to transfomer looping, that I wasnt able to decipher, especially the examples mentioned in the link below: http://publib.boulder.ibm.com/infocenter/iisinfsv/v8r5/index.jsp?topic=%2Fcom.ibm.swg.im.iis.ds.parjob.dev.doc%2Ftopics%2F...
by kumarjit
Tue Oct 30, 2012 8:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to know the basics of working with Loops in Transformer
Replies: 6
Views: 4175

Need to know the basics of working with Loops in Transformer

Maybe it would sound like something that has been already asked in many previous topics , but I am LITERALLY running out of sorts to understand how exactly the loop structure works in Transformers stages . I am posting this after being utterly confused by the facts given in the IBM Online manuals of...
by kumarjit
Tue Oct 30, 2012 8:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Get records with MAXIMUM value in a timestamp column
Replies: 8
Views: 4409

Sorry , my bad ...... :( ..... Probably because I'm a first time user ..... But, I dont really see the Reply to topic button in my login ........

Anyways , thanks for the info.....
by kumarjit
Tue Oct 30, 2012 3:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Get records with MAXIMUM value in a timestamp column
Replies: 8
Views: 4409

Thanks again. But, the things which I didn't understand are : a) How could you increment the value of the stage variable svCounter for EACH GROUP (MEMBER-PHONE) ? The reason fo asking so is , how could a Transformer stage identify each unique group of MEMBER-PHONE ? b) Why should I increment the val...
by kumarjit
Tue Oct 30, 2012 2:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Get records with MAXIMUM value in a timestamp column
Replies: 8
Views: 4409

Thanks for the reply Rajan.

I understood the first part, but things start to mess up from the point where you have mentioned "Code your transformer logic to filter out all the records in a group....".
Could you please elaborate ?

Thanks in advance,
Kumarjit.
by kumarjit
Tue Oct 30, 2012 1:22 am
Forum: General
Topic: Unlocking a Parallel job
Replies: 2
Views: 1177

Unlocking a Parallel job

Hi,
Is there any other way of unlocking a Datatstage Parallel job than using DS Adminstrator Client ?
Please share your thoughts.
Tried all ways known , but to no avail.

Thanks,
Kumarjit.
by kumarjit
Tue Oct 30, 2012 1:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Get records with MAXIMUM value in a timestamp column
Replies: 8
Views: 4409

Get records with MAXIMUM value in a timestamp column

Hi there , I am having a set of data with three columns : 1. MEMBER (varchar) 2. PHONE (varchar) 3. UPDATE_TIME (timestamp) The data looks something like this below : M1 P1 T1 M1 P1 T7 M1 P1 T1 M1 P1 T1 M2 P2 T8 M2 P2 T2 M2 P2 T6 M2 P2 T2 where M's stand for MEMBER, P's stand for PHONE and T's stand...