How to read redefines using parallel complex flat file stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
umamahes
Premium Member
Premium Member
Posts: 110
Joined: Tue Jul 04, 2006 9:08 pm

How to read redefines using parallel complex flat file stage

Post by umamahes »

I am having problem in reading redifines in complex flat file stage in parallel job so can any body help me in resolving this issue

I appreciate for that
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Do you have a separate output link for each record type?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
umamahes
Premium Member
Premium Member
Posts: 110
Joined: Tue Jul 04, 2006 9:08 pm

redifines

Post by umamahes »

YES I HAVE
HI
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

So what, precisely, is the problem that you are having? Is the metadata on each output one of the redefined table definitions? Are you getting any error messages logged by the CFF stage? If so, please post the exact text.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
michaeld
Premium Member
Premium Member
Posts: 88
Joined: Tue Apr 04, 2006 8:42 am
Location: Toronto, Canada

Post by michaeld »

You can't have more than one output link in a CFF. (except the reject link)
Mike
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You're right. The good news is that you can (have multiple output links from a CFF stage for each record type) in version 8.0.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
michaeld
Premium Member
Premium Member
Posts: 88
Joined: Tue Apr 04, 2006 8:42 am
Location: Toronto, Canada

Post by michaeld »

Ray, is there any way to do it in version 7.5?

Right now I just write all records that don't match the schema to a reject file and then read the reject file as a source to get the records for the second schema. I have two schemas. So I end up with two jobs.

I don't like this approach, but I can't think of anything better.
Mike
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Could the rejects link from the first CFF stage be directed into a second CFF stage (or even a Column Import stage) to handle the other record type in the same job?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
smrutiranjannayak
Participant
Posts: 22
Joined: Mon Apr 02, 2007 4:02 am
Location: MUMBAI
Contact:

You can use the below mentioned functions

Post by smrutiranjannayak »

Hi even once i faced the same scenario once

One way is CFF stage but i dont have much clarity on that....

I followed the alternate sequential file stage .

i.e , Use the data as a bunch for which you have redifinition and slice it accordingly as per your requirement .

Means if you have column position from 1 - 50 . The same bunch has been used twice or more by some other columns but with different data type .
So group this data into a stage variable and slice it cordingly each time.....

Cheers :lol:
Smrutiranjan Nayak
lfong
Premium Member
Premium Member
Posts: 42
Joined: Fri Sep 09, 2005 7:48 am

Post by lfong »

Could you not use the CFF stage into a transform stage. The transform stage would have have multiple outputs. Use constraints for each record type for each corresponding redefined definition.
smrutiranjannayak
Participant
Posts: 22
Joined: Mon Apr 02, 2007 4:02 am
Location: MUMBAI
Contact:

I had some other problems

Post by smrutiranjannayak »

Hi ,

The problem i am facing is :

The input file is not a fixed width file ( its a cobol data file )

I used CFF stage also to read the data means view the data.....i have some redifines and occurs clause .

So i am not able to do that .

Also suggest how to use redefines tab in CFF ( gurus pls answer) in case i am using more than one columns for redefined .

Can we do any individual column settings ??

Please advice .
Smrutiranjan Nayak
Post Reply