Hello,
I have staging table of around 70 columns with the datatype CHAR.
I'm not doing any validation and transformation before load to staging.
So I can expect junk or unknown or unwanted values in almost all the columns.
for eg., Date or integer field may contain alphanumeric values.Varchar field may contain junk values. Because these fields are declared as CHAR in staging.
My requirment is to reject those kind of records before I load from staging to base table. Because Base tables are datatype specific.
May I get your help to achieve this?
How to reject junk or unknown values
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 23
- Joined: Tue May 14, 2013 6:34 am
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
There is no "junk". Every character is part of the data you are being paid to process. The specifications you get from the data owner will tell you how to handle specific characters, even if you have to negotiate those specifications with the data owner. And that specification governs precisely what you must do. Anything not in the specification you do not do.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Ray put it clearly but I'll paraphrase:
"It's not 'junk' unless the customer tells you it is"
"It's not 'junk' unless the customer tells you it is"
<a href=http://www.worldcommunitygrid.org/team/ ... TZ9H4CGVP1 target="WCGWin">
</a>
</a>
-
- Participant
- Posts: 23
- Joined: Tue May 14, 2013 6:34 am