Capture rejects of different schemas to a single table

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chetan.c
Participant
Posts: 112
Joined: Tue Jan 17, 2012 2:09 am
Location: Bangalore

Capture rejects of different schemas to a single table

Post by chetan.c »

Hi,

I have 3 Oracle Tables with different schemas.
Each table has a reject link and the rejected records are captured in a Sequentail file.

The rejected records need to be captured in a target table whose definition is not yet defined as it depends on how we can capture these records.

Kindly let me know how this could be desinged.

Current thoughts in my mind is to concatenate all columns in a sequential file except RejectERRORCODE,RejectERRORTEXT and have 4 column table with filename and Reject inofrmation and actual reject Data.

Thanks,
Chetan.C
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I'd be curious what the purpose of the table would be. You've captured them all in one table... and then what? How you would leverage it would drive the design, it would seem to me.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Poovalingam
Participant
Posts: 111
Joined: Mon Nov 30, 2009 7:21 am
Location: Bangalore

Post by Poovalingam »

Hi Craig,

I have seen a similar kind of common error log table. This table will be used by support team to understand the reason for rejection. Sometimes business will query this table and ask for the fix if any significant data is identified as missed.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Sure, I've seen them too. But more interested in what our friend Chetan.C has to say on the subject. It's their table after all. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Chetan.C tells us that the table design has yet to be defined. I think that doing that is the absolutely vital first step - what information about data errors does Chetan.C need to capture?

This is not something we can do (in spite of having some experience in these areas). Chetan.C must come up with Chetan.C's requirements.

I'd be happy to design the table, but that counts as consulting and comes at a fee.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
aartlett
Charter Member
Charter Member
Posts: 152
Joined: Fri Apr 23, 2004 6:44 pm
Location: Australia

Post by aartlett »

What happens if you ask a consultant the time?

He asks to borrow your watch, tells you and then keeps it.

I've "consulted" on this situation many times, and the down and dirty normally is a lot of data collected and stored for absoulutly no reason.
Andrew

Think outside the Datastage you work in.

There is no True Way, but there are true ways.
chetan.c
Participant
Posts: 112
Joined: Tue Jan 17, 2012 2:09 am
Location: Bangalore

Post by chetan.c »

chulett wrote:Sure, I've seen them too. But more interested in what our friend Chetan.C has to say on the subject. It's their table after all. :wink: ...
:) I did ask the same question , and the answer was "what's way the best way we can be showing this ?" ... so decided to give it a try.
chetan.c
Participant
Posts: 112
Joined: Tue Jan 17, 2012 2:09 am
Location: Bangalore

Post by chetan.c »

ray.wurlod wrote:Chetan.C tells us that the table design has yet to be defined. I think that doing that is the absolutely vital first step - what information about data errors does Chetan.C need to capture?
:) Well , Chetan.C has been asked to see how best he can be showing the data without any specification as to how they want to see it ( or even who will be seeing it)

Today , I have insisted on who will be looking into this and how they want to look at it ( Querying a table or through a web portal) and waiting for an answer :wink:

As for the consulation fee Ray , I think the knowledge you all veterans have here is priceless :) .

Thanks,
Chetan.C
BI-RMA
Premium Member
Premium Member
Posts: 463
Joined: Sun Nov 01, 2009 3:55 pm
Location: Hamburg

Post by BI-RMA »

One of the easiest ways to store data of different formats into a table or file with identical format is to combine all or selected columns of a record in a single column using the Column Export Stage.

This action can be reversed using the Column Import Stage.
"It is not the lucky ones are grateful.
There are the grateful those are happy." Francis Bacon
Post Reply