DSXchange

Congrats Ray and thank you for letting us dive into your treasure trove of wisdom.

Got a hang of how I should do it. Will post the solution once I get through.

Server Jobs aren't an option in my project. Is there a way to achieve it in my parallel job?

Db2. I'm sorry, I ought to have mentioned it.

Hi, I wasn't too sure if this was the right place to post but I'm sure there are some SQL gurus here too. Kindly help. We have a table that looks something like LN_NBR RPT_DATE SN_AMT My requirement is to select the MIN(SN_AMT) for a given LN_NBR within a given set of RPT_DATE. The RPT_DATE range is...

If your source is a database, I suggest you push this processing to the database. SQL OLAP functions are very efficient will provided optimal performance for the stated requirement unless of course you WANT to implement it using Datastage only.

Woww! For real?! Is it because the checksum generated is hexadecimal in nature?

Thank you Ray, Craig and Roland. The information provided by you is sufficient for me to proceed with a POC and take a decision.

chulett wrote:...And your data volumes have nothing to do with the 'reliability' of this approach... just the speed....

This was the doubt I had. Since it's a 32 bit code, it would produce 2^32-1 values, right? Or is that understanding wrong?

Good chance that there are duplicates in the other links on the Join key.

Assuming significant performance gains, is CRC32 reliable enough for the data volumes mentioned? Are there optimal alternatives to this approach?

I thought that comparing a single Checksum column would be more efficient than comparing each of the 40-50 columns. This is my idea behind using Checksum. To answer your second question - This is not going to be a daily batch job that's going to go live but is going to be run every day for the next ...

We're trying to do some work on trying to find if the incremental data provided by our client's partners are indeed reliable and if yes, to what degree. To achieve this, we are performing the below exercise: 1. Day 1 - Take a full extract of the source from the partner for Day 1 2. Day 2 - Take a fu...

If on DataStage 8.5 or below, this is what I could think of. $INCLUDE DSINCLUDE JOBCONTROL.H Link_Handle = DSAttachJob(JobName,DSJ.ERRNONE) PenultimateStageName = DSGetLinkInfo(Link_Handle,TargetStageName,LinkName,DSJ.LINKSTAGE) Ans=DSGetLinkInfo(Link_Handle,PenultimateStageName,LinkName,DSJ.LINKROW...

The input link to your target stage will be the output link to some stage, right? Pass the name of the penultimate stage that feeds your target as the 'Stage Name'.