DSXchange

Oooops!! Missed that. Yeah, Kenneth. Thanks again. The need came intuitively to me, and the possibility was addressed here in this forum, and the direction given here and in your performance doc. Thanks all of you.

gateleys

I tried parallelizing my process, with 3 separate parallel links from input feeding the output link. MOD(@INROWNUM,3) = PartitionNumber - 1 was used as constraint in the transformer, where the partition number is a job parameter, as specified in Kenneth's doc. The problem is that I get an error that...

I really appreciate your comments. However, will someone please take me a step ahead of what Kenneth has suggested in terms of using job instances. How do I create it, and how do I specify constraints to split my input rows into different portions that can feed each processor. All I can see is the A...

oh!!

Absolutely. Use job instances with a constraint that divides the rows evenly among the instances. I've got a document on my website called Performance Analysis which covers this effort. Hi Kenneth, Sorry about yanking part of your response. Can you provide some more guidelines into creating multipl...

Did you try using Link partitioner. As far as I have read from Rays post that in server, the only way to use parallelism is using the Link Partitioner stage. I have used Link Partitioner and Collector in situations where the input rows can be seggregated based on certain conditions applied at the t...

What's your input stage? Flat-file? What about your output stage?

gateleys

Our DataStage server runs on an SMP with 4 processors. Now, let's say I have a simple job, with a flat-file as source and a transformer with outlinks to ORAOCI9 (just inserts) and Reject_file. With the inprocess and interprocess buffers left at default, will the server split the load among the proce...

I was going thru' some previous postings on analyzing your input data and posting trial values for Array Size and Rows per Transaction before achieving an optimal performance while using OCI9. I came across a posting by Ray- I just had a report from a customer as follows. Job design is OCI9 -----> H...

chulett wrote:We all know you really mean Kim. It's probably just his sig that threw you off.

Oh yes, I meant Kim. But Craig has come to my rescue many a times too. Kim, you still did not provide answer about ParameterNavigator's compliance with DS7.0, and the $ Amount.

gateleys

Thanks Craig, Your response has allowed me to get a better understanding of the internal structures of these jobs, and hence be able to manipulate them (with your help again). You guys are awesome. Oh yeah, I wish I had the authority to make purchases, but sure can influence them. Does the Parameter...

Hi D.S Gurus: I'm new to Datastage.I need your suggestions for implementing the logic. Here is the situation X is the source Y is the target Z is a target in a warehouse Today the job was run X->Y-->Z Tommorow, certain rows from X are deleted I need to update those records in Z which are deleted in...

If you are using a user-defined SQL in the OCI stage and passing the result to a hashed file, you already have the data available. Now, make use of this data....may be via a lookup, as Naveen suggested, in other jobs. Or, may be I did not understand your question!!

gateleys

Kenneth and Ray have provided their suggestions into this. Follow THIS LINK to a previous post.

In your transform derivation do a EREPLACE(In.DSXLine,'Value "MY_DB_NAME"','Value "#DBPARM#"') You will also need to make sure that your job has this DBPARM declared as a parameter, if not then this also needs to get added to the DSX output file, otherwise the new jobs will not ...