DSXchange

Closer to 2.2GB and writes will fail (and it may corrupt) when the limit is exceeded. Time to switch to -64BIT or investigate the "resize" command to convert an existing 32bit hashed file. ... Thanks for quick response. Are we already at 2.2GB or the limit of hash file is 2.2GB? Do you ad...

Hi All, We have a static hash file that we clear and re-create every month in our production cycle. I think the hash file limit is up to 2GB. I am wondering if we are close to the size of hash file or did we exceed already? What will happen if we exceed 2GB does the job fail or does it overwrite the...

Craig, Thanks for the explanation you are correct, it will strip of the quote characters and the rest when you reopen the stage. I tried to parameterize all the sort options like sort #opts# #FileName#.txt where opts = -t"|" -r -k1 and it works, meaning it will not strip when you open it n...

Hello All,

Is there a way we can find out the category and job names in which a specific stage is used? For example can I find out all the job names which used a pivot stage or row merger stage in a specific project? Any administrator commands which can solve this?

thanks

Hello All, I need some help in understanding the filter command option on the seqfile stage. When do we use these filter commands and what kind of filter commands we can use in the Filter command text box. Can we use any kind of UNIX commands? I tried to use the sort command using the -t"|"...

Two input flat files with two columns each File 1: Rec_Cnt Total_Amount 125 5000.00 File 2: Rec_cnt Total_Amount 275 15000.00 OutputFile: Record count from the second file and total amount from the first file. Rec_cnt Total_Amount 275 5000.00 There are no keys in the two files. The way I tried is to...

Hello All, I saw many posts about the divide and conquer rule and I am planning to follow the same for the performance of my job. My job design is, reading a seq file with 30 million records and writing it to four different files based on the constraints. I need some ideas in building a multi instan...

You guys are great!!!!!! It was the space issue and I used the -T option and it worked fine. I should have thougth of this before but we learn new things from experience.

thanks

Hello All, I was using a ExecSH as a before routine in which I used a sort command to sort the specific columns. In development it worked perfectly well and in UAT it failed leaving the error. sort: A write error occurred while sorting. The command I used is sort -k5,5 -k10,10 -k1,1 file1 file2 > fi...

ray.wurlod wrote:I don't have access to DataStage this week. Will follow up (or someone else will) soon.

Thanks Ray. I added the count of days logic also in my previous post.

thanks

Ray, Thanks for the quick reply. I am taking all the column as arguments in the routine and trying to implement the logic. Ex: the InLink.MBNR will be stored in a stagevariable as sv1 and my routine arguments will be the InLink.MBNR, sv1 to compare the current and previous MBNR column values. But so...

A routine must return its result through a variable called Ans - your routine code does not appear to assign a value to this variable. Ray, Sorry I forgot to copy the Ans. The routine should return the count. Here it is Ans = Count Here is an example and CNBR( 3 rd column is the key) MNBR PNBR CNBR...

Hello All, I am repating this post http://www.dsxchange.com/viewtopic.php?t=92268&highlight=routine+fix as I tried my best to fix but no luck. So guys I need some help here. Below is my routine and it works like a charm.(The database count field is '0' upto this point and I have to populate the ...

The initial count value will be equal to 0 and the count should return values based on the conditions below with a flag where the current and previous row are equal or not. If (CurrMCol <> PrevMCol) AND (CurrPCol <> PrvPCol) and Code 20,29 then count = 0 else count = 1 If (CurrMCol = PrevMCol) AND (...

Sai, Thanks.

Below is the req if the condition is false

If Not ((CurrMCol = PrevMCol)AND(CurrPCol = PrvPCol)) and MaxEndDt = EndDate and stCode in (20,29)
then 0 else 1

I tried to initialize the count to 0 at the beginning and all the result is getting concatenated with 0 and the flag 0|Y.


thanks