DSXchange

I would like to improve the performance of my job. If anyone can help me with some ideas should be great. Please suggest me if a change in design or change in stage can give me any better. My job is like this. Job1 . Dataset (xmls) --> XML Input stage -> move data of 40 different complex elements to...

hI...

Is there any help availabe for the MQ connectivity from Datstage...

Can you direct me the article which has that...

I was doing Unix shell scripting to achive the same. It's in the final stage. So I will use an exec command stge n sequncer to call my Unix script wo do the same for me. It was really helpful. Thanks a lot for everyone who supported me. I am marking this post as 'Resolved with workaround" Thanks.

Probably a simpler solution could be to 1.) combine both files into a single one 2.) ordered by key, fromDate and toDate 3.) append an extra dummy (end-of-file) record (if parallel, then 1 for each node) 4.) Using stage variables, compare current record with previous record and write out previous r...

Interesting problem. Four questions: 1) I assume it is a many to many relationship? There can be multiple records in both File 1 and File 2 with the same keys? 2) What do you do if a price in File 1 is completely overlaid (start to finish) by a higher priority price in file 2? Eliminate the record?...

Hi , I have a output to achieve for which my experience in datastage is not helping much. I request if anyone can help me. My Input ----------- FILE 1 PID ORG DC Stdate EndDate Price P1 10 1 1-MAR-10 30-OCT-10 100 FILE 2 PID ORG DC Stdate EndDate Price P1 10 1 22-MAR-10 1-OCT-10 98 MY OUTPUT SHOULD ...

yes its working... I put validity chk

sohasaid wrote:You might miss dashes, try this:

StringToDate(incolumn,'%yyyy-%mm-%dd')

Not actully. Since my input source don't have the format 9999-12-31, I did not use that format. Any help

Hi, I have a source datacolumn seldate in the form of 99991231 coming from a flatfile. Length of this field is varchar 8 I have to insert that to DB2 table using a DB2 enterprise stage. I am following the steps below. 1 In the derivation of transformer stage I am using the following function. String...

Thats a good explanation....

I am happy with that.....

One Activity... one stage...

Thanks a lot ...

ETLJOB wrote:I hope this post from Vincent should be good enough for your question.

viewtopic.php?t=95243&highlight=surrogate+key

This wonn't answer my question. I basically know the various approches, but my question is different.

Hi, In my job I have to generate surrogate key for records , my job also has a transformer stage to do some calcualtions. Since traformer stage also give the functionality of generating surrogate key, is it required to use the surrogate key stage separatly. Is it a good design/approach to make use o...

Thanks ray...

I knew that option.... but I thought if I can avoid this costly transformer with a filter stage for this simple operation..... That prompted me to ask this...

I hope we cannot do that in filter right....

I have the following flow... Flat File -----------> Filter -------> remaining stages. In flat file, I have a field product_id. I want to process only those records where the product_id is not null or blank. I used the following statment in the where clause of a filter stage... Trim(product_id)<>'' B...

In my experience.. lookup fileset did a better job than the dataset....

I stand for Lookup file set than DS.

Thanks for your reply. I m closing this thread.