warning due to seq file in parallell EX

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

warning due to seq file in parallell EX

Post by kumar_s »

Hi,
I have a sequential file as the reject file. rejects are from filter, merge...
But i am getting the following warings

Code: Select all

REJECT_01: When checking operator: A sequential operator cannot preserve the partitioning
 of the parallel data set on input port 0.
I understand this is due that, i am using seqential file in the DS PX.
Is there any way i can get rid of this warining.

I tried changing the partition method for the reject file as Auto,Round Robin, Hash. No go....

Any clue

regards
kumar
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

Is this to a reject link? In that case I don't think you can make the warning disappear; you could put a transform stage between the database stage and your sequential output file, that should work.
thebird
Participant
Posts: 254
Joined: Thu Jan 06, 2005 12:11 am
Location: India
Contact:

Re: warning due to seq file in parallell EX

Post by thebird »

kumar_s wrote:Hi,
I have a sequential file as the reject file. rejects are from filter, merge...
But i am getting the following warings

Code: Select all

REJECT_01: When checking operator: A sequential operator cannot preserve the partitioning
 of the parallel data set on input port 0.
I understand this is due that, i am using seqential file in the DS PX.
Is there any way i can get rid of this warining.

I tried changing the partition method for the reject file as Auto,Round Robin, Hash. No go....

Any clue

regards
kumar

Hi,

You can get rid of this warning or error by setting the preserve partition mode of the preceding stage/stages to "clear".

This property is in the Advanced tab of the Stage property.

This is happening because the sequential file always run in a sequential mode, but the preserve partition mode of most of the stages by default is set to "propagate". When this property is set to "propagate" the stage tries to maintain the same partioning mode and this would not be possible in a sequential file, and hence the warning/ error.

Regards,

The Bird.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Hi,
though i insert transformer and pass on the same column, it shows me the same error.
But when i clear the paritition it get fixed, but i really bothered about this arrangement, what ll be the partition for the rest of the flow....
:roll:

regards
kumar
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Whatever you specify on the input links of downstream stages.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Hi,

the input link of th downstrem stage contains SAME partition.
i relly confused, what partition will be maintained if i cleared it the previous stage.
will it be roundrobin (which i dont needt :x )
May i know where can we find these information,
is in OSH or in exproted dsx/xml.
i could not even see for all stages in exported files.

thanks

regards
kumar
elavenil
Premium Member
Premium Member
Posts: 467
Joined: Thu Jan 31, 2002 10:20 pm
Location: Singapore

Post by elavenil »

Hi,

If you choose 'clear' option in preserve partitioning, the warning message would disappear.

Set 'APT_DUMP_SCORE' env variable to true, then you should be able to identify what partitions are used in the flow/job by viewing log details of job.

HTWH.

Regards
Saravanan
Post Reply