Jobs contain lesser fields than defined in metadata

rumu · Post by **rumu** » Mon Dec 11, 2006 5:15 am

Hi All,
I am new to Px.I am facing the following problem:
In metadata tehre is 12 fields.In source it is sometimes comimg 11 or 12.When the no of col is 11 then the job is failing.
we r using sequential file stage to read data.
Like ServerJobs is there ny property to set "Missing columns action"?

Pls suggest.

Thanks in advance.

Regards,

rumu

thebird · Post by **thebird** » Mon Dec 11, 2006 8:34 am

rumu wrote: Like ServerJobs is there ny property to set "Missing columns action"?
rumu

You can set the Reject Mode option inside the Sequential File stage to "Output" to capture all records that have a mismatch in the defined metadata, in a reject link.

If you set this property to "Continue" then the job will simply discard such records and finish to completion.

Aneesh

ray.wurlod · Post by **ray.wurlod** » Mon Dec 11, 2006 2:09 pm

There is no "missing columns action" in parallel Sequential File stage.

rumu · Post by **rumu** » Mon Dec 11, 2006 9:43 pm

ray.wurlod wrote:There is no "missing columns action" in parallel Sequential File stage. ...

Hi Ray,
I have to pass all records whether the column is present or not.
Pls suggest how to achievs that?

Regards,

rumu

ray.wurlod · Post by **ray.wurlod** » Mon Dec 11, 2006 9:57 pm

Capture the short rows in the reject link as a raw string. Run this through a Column Import stage to parse it into the eleven columns, then through a Column Generator stage to add the twelfth column. Bring both streams together using a Funnel stage.

vmcburney · Post by **vmcburney** » Mon Dec 11, 2006 11:29 pm

You could also import it as 11 columns and split the 11th and 12th columns in a transformer stage. Not completely sure if this will work!

DSXchange

Jobs contain lesser fields than defined in metadata

Jobs contain lesser fields than defined in metadata

Re: Jobs contain lesser fields than defined in metadata