Schema File

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Nagac
Premium Member
Premium Member
Posts: 127
Joined: Tue Mar 29, 2011 11:39 am
Location: India

Schema File

Post by Nagac »

Hi,

I have Common Job which extracts the data from multiple files with n number of fields. In Job, we use Column Import Stage with Schema File to import into multiple fields as we initially read file as single field.

When we do testing we send more no. of delimiters(|) than expected(Eg: we have two fields, but we send 5 delimiters. We expect it should reject the row but it has sent the rows to output with
Col1, Col2
Value1,|||||

Thanks
Kryt0n
Participant
Posts: 584
Joined: Wed Jun 22, 2005 7:28 pm

Post by Kryt0n »

From what little I can remember, the last column consumes until the record delimiter (or its width if happens first).

Use a transformer prior to import stage and count the number of delimiters
Nagac
Premium Member
Premium Member
Posts: 127
Joined: Tue Mar 29, 2011 11:39 am
Location: India

Post by Nagac »

Thanks Kryt0n, i thought there will be solution in Schema File.
Post Reply