CRC32/Checksum

mdbatra · Post by **mdbatra** » Mon Dec 22, 2008 6:02 am

I want to generate a unique number for the concatenation of all my columns in the records. We have CRC32/Checksum available in Server Transformer & same in parallel Basic transformer.
I can't use a Server job & basic transformer as well.
Any other way to acheive the functionality in a parallel job.

Thanks

chulett · Post by **chulett** » Mon Dec 22, 2008 8:19 am

Write your own as a BuildOp, plenty of C/C++ code out there for the taking, I would think.

ray.wurlod · Post by **ray.wurlod** » Mon Dec 22, 2008 2:13 pm

mdbatra wrote:I can't use a Server job & basic transformer as well.

Why not? Everyone else can.

kduke · Post by **kduke** » Mon Dec 22, 2008 3:44 pm

There are several posts on this. I could never make it work. It was inconsistent across servers.

chulett · Post by **chulett** » Mon Dec 22, 2008 4:12 pm

You are talking about CRC32, not BASIC transformers in Parallel jobs, yes? I seem to recall some of the odd issues you had with it...

mdbatra · Post by **mdbatra** » Tue Dec 23, 2008 2:37 am

chulett wrote:You are talking about CRC32, not BASIC transformers in Parallel jobs, yes? I seem to recall some of the odd issues you had with it... ...

Yes Craig, i am just asking about how to use CRC32 in a parallel job, but without using a basic transformer.

ray.wurlod · Post by **ray.wurlod** » Tue Dec 23, 2008 3:27 am

And the answer is to create a parallel routine which invokes one of the public domain CRC32 functions already out there.

mdbatra · Post by **mdbatra** » Tue Dec 23, 2008 4:11 am

Ok...that's fine !
Thanks

chulett · Post by **chulett** » Tue Dec 23, 2008 9:17 am

mdbatra wrote:
chulett wrote:You are talking about CRC32, not BASIC transformers in Parallel jobs, yes? I seem to recall some of the odd issues you had with it... ...
Yes Craig, i am just asking about how to use CRC32 in a parallel job, but without using a basic transformer.

That question was actually to Kim.

mdbatra · Post by **mdbatra** » Tue Dec 23, 2008 10:44 am

well...pardon me for that !

kduke · Post by **kduke** » Tue Dec 23, 2008 11:30 am

I tried to implement the public domain one. It is based on compiler overflow. It seems to be inconsistent across compilers, versions of OS, versions of DataStage and other critical issues.

ray.wurlod · Post by **ray.wurlod** » Tue Dec 23, 2008 12:45 pm

There is a Checksum stage in version 8.1.

DSXchange

CRC32/Checksum

CRC32/Checksum

Re: CRC32/Checksum