Issue with Job sequencer

[aladap12]

Good Morning all and wish u happy new year

Secondly, we are using datastage server jobs with 7x release

I have issue with my job sequencer.

In my process i have job that writes data in flat file, in the next step we send that file to other server via FTP.
Some time we don't process any records, at that time empty file was sent to other server.

I have to change my job like if i don't have any data on the file, the i should not send this file to other server.

how would i achive this functonality in datastage

here in this job sequence i am using execute command activity. that will
fire the Ftp script and sends the file to other server

please let me know

[chulett]

In the Sequence job, before the FTP step, check the size of the file and don't trigger the FTP if the file is empty. Or check in your FTP script.

[dspxlearn]

Use a execute command stage before your FTP stuff as Craig said.
So, your JOb sequencer design would be:

Code: Select all

ExtractJob --> ExecuteCommandStage --> FTP Job

In Executecommand stage use:
Command: awk
Parameters: '{print $1}' #TargetPath#/#FileName#

After extract job is completed, ExecuteCommandStage should invoke the Unix box to check the file content.
In the condition to FTP job use

Code: Select all

Trim(Convert(@FM, "", Execute_Command.$CommandOutput)) <> '' 

So, if file size is not equal to empty, the FTP job will trigger.
@FM is used to get rid of any linefeeds in the file.

[chulett]

Rather than awk the entire file, a simple conditional expression could be used to check the file. For example:

Code: Select all

-s file        True if file exists and has size greater than zero.

[dspxlearn]

Craig,

I was also checking the content of the file and if and blank spaces or line feeds, those will be converted to empty. Cause, with these stuff, the file size will be increased.

Code: Select all

Rather than awk the entire file, a simple conditional expression could be used to check the file. For example: 

Code: 
-s file        True if file exists and has size greater than zero.

Can you please let us know how this is used in the execute command stage?

[chulett]

With 'test'.

Code: Select all

test -s filename

Returns true if the file exists and is greater than zero bytes in size, otherwise it returns false. Reverse the check with the bang:

Code: Select all

test ! -s filename

Returns true if the file doesn't exist or exists and is zero bytes in size.

[dspxlearn]

Craig,

Thank you very much!! New point noted. :D

aladap12 ,
If your issue is resolved please let us know the results and mark this thread as resolved. Manwhil, I will also test this.

[aladap12]

Thanks for your valuble suggestions,

I will try this way and let u know if my prob is solveds

Thanks
Krishna