DSXchange

I do not need to worry about the year after leap year. I compare two dates (to and fro) and if the fro date is less than the to date, then increase the year by one on the fro date. Thanks.

Thanks Mark.

If you want a left outer join between the two tables with all keys I believe the the SAS logic does not do left outer join between the two tables with all keys . The SAS code does the following: D1 left join D2 when D1.C1 = D2.C1 and D2.C1 = D2.C2 and D3.C3 = '' and D4.C4 = '' Does this mean that t...

Hello, We have a field stored as Date type in the following format: 10/18/11. I am looking for options to increase the year by one (to 10/18/12). Any suggestions are highly appreciated. Also, is my following understanding of DaysSinceFromDate() function right. DaysSinceFromDate(10/17/12, 10/18/12) w...

Deeplind - I tried filtering after the join stage and the DS record count was different from SAS record count.

I believe I will implement Manoj's suggestion of nul handling.

Thanks

chulett wrote:If your join key columns are null on one side or the other, then you'll need to look into some flavor of a outer join. An inner join will never return any records where join keys are null.

I am using a left outer join and sorry that I did not mention it earlier.

Thanks Craig. I am converting SAS logic into DataStage and the SAS code had check for the null within the join logic. When I filter it after the join stage in DS, the DS record count is different from the SAS record count. The record count in SAS is the same with or without the check for null key co...

Thanks Craig.

Hello, A parallel job has a join stage that performs a left join based on 4 key columns on the left dataset and right dataset. The join must also include additional columns that have a null value in the left dataset. Let us call our two datasets D1 and D2 and the key columns as C1,C2,C3,C4. D1 left ...

Hello, There is a parallel job that has multiple (4-5) join stages. The join keys are about 10 in each stage but the input into the join stages have anywhere between 70-120 columns. I am looking at ways to decrease the total run time for the job. I am wondering if using RCP will help me in this proc...

Thanks guys.
I made some changes to the business logic and the comparision of dates seems to be working fine now. I will mark the post as resolved.

Thanks.

Hello, A comparision is made between two date columns D1 and D2. D1 is of date datatype throughout the job but D2 is transformed and converted into a date datatype before the comparision. There are more than 500,000 rows to be compared. The date comparision gives an "Invalid Julian day" er...

Thanks Craig.

I will implement your suggestion and update my post accordingly.

Hello, I have a job that has a start and end loop acitivity and a bunch of steps being repeated n times. I need to create/overwrite an output file when the loop is executed the first time and then append to the same file for subsequent iterations of the loop. What are some of the possible ways of do...

Use a link sort with hash partition instead of using a sort stage. I removed the sort stage and used hash partition and sort in the join stage itself. Now, I get the right record count but the time taken is similar to the time taken before the use of harsh partition and sort. So, I guess the only w...