Regarding Rejected Data

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
verify
Premium Member
Premium Member
Posts: 99
Joined: Sun Mar 30, 2008 8:35 am

Regarding Rejected Data

Post by verify »

Hi ALL ,
I am using Datastage 8.0.1 version.My Job design is as below

Sequential Stage --->> transformer ----> Oracle database

Input File Format :

123456abcd99zzzz6789

Delimiter : none

Field1 : 1234.56 ( decimal )

Field2: abcd

Field3: 99

Field4:zzzz

Field5:6789

Like that I have 60 Fields .

I am using a reject link at the sequential stage .The purpose of this is to

reject the data that is coming against the metadata specified in the input

sequential stage .When I run the job , I am getting the data in the reject

link.Because I am having 60 fields.I am unable to judge which field

datatype is deviating what is specified in the sequential stage .

if one field metadata is different that entire record is getting

rejected .Could anybody suggest How to know the field due to which the

record getting rejected .Thanks in advance .
RK Raju
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Your metadata (table definition) should specify a field width for each field. This is mandatory when there are no delimiters. It is via the field widths that the record is parsed into its constituent fields.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
verify
Premium Member
Premium Member
Posts: 99
Joined: Sun Mar 30, 2008 8:35 am

Post by verify »

Hi ,
Ray , Thank you for your reply .I think I am not precise in the question.I am using field width to parse the fields and I am able to get the data in the o/p for some records .But , the problem is for some date fields , I specified the width for those fields as 8.

If the records have date field as 00000000 , then those records containing date fields as 00000000 is getting rejected.There are many date fields in the metadata.Whenever I am getting value as 00000000 for any of the date field , Its getting rejected.I want the name of the field whose value is different from the metadata specified.Hope my requirement is clear .Thank you .
RK Raju
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

That is because 00000000 is not a valid date. Specify as Char(8) and perform IsValid() and conversions within your job, or specify 00000000 as the null field value.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
senthilt1
Participant
Posts: 134
Joined: Mon Nov 19, 2007 2:17 am

Post by senthilt1 »

Hi Ray,

I too have a same doubt, sorry for jumping in.

Your point is valid Ray.

But how to identify that, only due to this data field the record get rejected?

Is there anyway that we can find out the field due to which the record get rejected?

Thanks,

Regards,
Senthil P
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

No, the field which triggered the error is not returned from the database, so it cannot be displayed, just the standard SQL and error codes.
senthilt1
Participant
Posts: 134
Joined: Mon Nov 19, 2007 2:17 am

Post by senthilt1 »

Oh....So it means, we need to check it manually, why the record get rejected.

Thanks ArndW!
Post Reply