DSXchange

Ok, It looks as though this is a partition issue. Because my sort was on three fields, the partition was hashed on all three of these fields. However, only two of the fields defined a group. Therefore, it was possible for my group to be split up among two partitions. It looks like this issue is reso...

The end of this post may be useful. It provides some links to the documentation and some pitfalls where newer links take you to the wrong downloads.

http://dsxchange.com/viewtopic.php?t=11 ... 2f05115985

-Jason

I posted about a very similar situation last week, and thought I could extend my new found knowledge to do a more complex operation. Refer to http://dsxchange.com/viewtopic.php?t=119708&sid=11ebd5f06328134ece40a05a2d49fcce for the old post. I am trying to sort records by two ID's, and a mod numb...

Haha, absolutely. And I actually just used your logic to do a similar but different task:

Sort by - KEY, SUBKEY, MOD
Stage Variable - Select all of the records with highest mod per KEY + SUBKEY group.

This selects multiple records as opposed to just the top record.


Thanks again,
Jason

Thanks for the input, the issue I was having is now resolved. I tested your method chulett, and it worked perfectly, however, I ended up going with balajsr's method because it was closer to my original thought process. Oddjob, I didn't use that method because I wanted to store 'old' records instead ...

One part of that I'm not familiar with...

svCurrGroup derivation = KEY : SUBKEY

The 'derivation' part, I've never seen that before. Is this a special type of statement?

Thanks,
Jason

Thanks Chulett. All of that seems to make sense. I'll either be back with questions or with my problem resolved!

Thanks again,
Jason

Thanks for the response chulett.

I'm not sure I understand what you mean when you say 'group change detection'. The only capacity that I know how to detect groups is through the keychange field. I tried this in the above scenario with no luck.

Thanks,
Jason

Hi, I have a seemingly simple task that is causing me a lot of grief. I am needing to sort data and then within that group of data, sort descending and take the top record. To explain further, let's say my data looks like this... KEY : 1234 SUBKEY : ABCD MOD : 01 KEY : 5678 SUBKEY : EFGH MOD : 04 KE...

This is a modified version of the above routine. The modification simply takes the above code and implements it as a before/after Job routine for a Windows based server. * InputArg is a DOS expression and can make use of the * and other DOS expressions * $ surrounds the file name expression of Input...

Ok, I tested the custom triggers with a job that had a failed status, warning status, and ok status. The custom expression always evaluated to true, as is obvious now that I understand these triggers a little better. I used what you suggested and that worked perfectly. In the test, I used a Job Acti...

Ahh yes, that makes sense. I will test a job real quick that aborts and see if the expression still holds true.

So, if I'm using a custom trigger, I shouldn't use these pseudo expressions? Instead I should use something like:

Thanks,
Jason

Hi, This expression is to pass jobs that complete with and without warnings. I ran a test to see if the expression functioned correctly, and it looks like it did, but I wanted to verify with anyone who understood these Sequence expressions better. It is different from the information that I have fou...

Does anyone have experience deploying Datastage 8.0.1 on a 64 bit Windows platform. From what I've read, it isn't officially supported, but has been done. The organization I'm at is wanting to use Datastage with a 64 bit SQL Server along with SSRS all on the same server. My initial assumption is not...