Avoiding 0 byte Sequential File creation

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
SachinCho
Participant
Posts: 45
Joined: Thu Jan 14, 2010 1:23 am
Location: Pune

Avoiding 0 byte Sequential File creation

Post by SachinCho »

Hi,
I have one parallel job in which is common for two processes. Depending upon process name there are two flows inside it say A and B. Now if process name is A it generates XML file and if process name is B then it generates seq file.
Requirement is if job runs for process A then only XML file should be generated while actually 0 byte seq file of process B is also getting generated.

Any idea how to restrict this in job itself. Process flow is seperated after transformer.
Sachin C
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

While you cannot prevent the file creation, you could add an after-job call to UNIX which would delete those files if empty.
gssr
Participant
Posts: 243
Joined: Fri Jan 09, 2009 12:51 am
Location: India

Re: Avoiding 0 byte Sequential File creation

Post by gssr »

SachinCho wrote:Hi,
I have one parallel job in which is common for two processes. Depending upon process name there are two flows inside it say A and B. Now if process name is A it generates XML file and if process name is B then it generates seq file.
Can you provide the Job Design and stages deployed. So that everyone get a clear idea about the creation of XML and Seq File.
RAJ
gssr
Participant
Posts: 243
Joined: Fri Jan 09, 2009 12:51 am
Location: India

Re: Avoiding 0 byte Sequential File creation

Post by gssr »

SachinCho wrote:Hi,
I have one parallel job in which is common for two processes. Depending upon process name there are two flows inside it say A and B. Now if process name is A it generates XML file and if process name is B then it generates seq file.
Can you provide the Job Design and stages deployed. So that everyone get a clear idea about the creation of XML and Seq File.
RAJ
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Doesn't really matter as (bottom line) the file creation cannot be avoided. The stage creates the file when the job starts, regardless of 'flow'. Arnd has noted the typical 'workaround' for this.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply