Help with Logic on Rejecting Records.

[Kel]

Hi Everyone,

I have a stream of data that looks like this

col1|col2|col3|col4|col5
Null|Inconsistent|Valid|Valid|Valid
Valid|Valid|Valid|Valid|Valid
Null|Valid|Valid|Valid|Valid
Valid|Inconsistent|Valid|Valid|Valid

Now our problem is on the transformer stage we do a constraint which when Column is null or inconsistent it goes to a shared container. On the shared container stage, there is a certain column, whose value is the Column name of the record that is null or inconsistent. We have a problem on row 1, because it is both null and inconsistent. With our present constraint, it will just generate one row at the shared container. And we need two rows to be generated , one for null on col1, and other for inconsistent on col2.

I like to ask how can on what logic do I need to get the desired output.

Thanks.

[ray.wurlod]

You need a Transformer with a loop to traverse the columns to detect any invalid or null, and to transfer the row to the output link (possibly with diagnostics) when either is found.

[Kel]

Hi ray,

Is there an option on looping on transformer stage available. We are currently using Datastage 8.1

Thanks.

[chulett]

Without the loop, could you not set up individual output links for each column and constraints to control them? Then a Funnel to put them back together.

[ray.wurlod]

And, from memory, you don't get Transformer looping till version 8.5.
Seriously, version 8.1 is really old now. It's out of support. Any reason you can't upgrade?

[chulett]

+1