Page 1 of 1

Unable to Attach large Files (20 MB) and above

Posted: Mon Jun 20, 2011 4:21 am
by uppalapati2003
Hi ,

We have a job(Server 7.5) that generates a report in a comma separated format (CSV), and automatically send it across to the desired recipients through the Notification Stage. As the report size is growing day by day the notification stage is unable to mail the file from couple of weeks. As the file size is close to 20 MB.
we have tried with zipping as well,but it may not be appropriate as the files size is keep on growing every day.
Thought of FTP the file but business request this in the mail as an attachment.
Can you please advise your thoughts on how to achieve/overcome this problem?

Thanks
Srini

Posted: Mon Jun 20, 2011 4:47 am
by MarkB
I guess the first thought is - why is the file size so huge? Any way to pare down the size? Other than that, a .csv file is just text, and zipping it should drastically reduce the size of it. I can't see it being an issue.

Posted: Mon Jun 20, 2011 7:11 am
by chulett
There is a definite limit on email sizes, that's why file sharing sites exist. Something that size you'll need to upload or ftp, either that or break it up and send it in multiple (separate) pieces.

Posted: Mon Jun 20, 2011 5:51 pm
by ray.wurlod
Note that this limit is imposed by your mail client, not by DataStage.

Can you write the file to a shared drive and send a link to it?

Posted: Mon Jun 20, 2011 6:05 pm
by chulett
ray.wurlod wrote:Note that this limit is imposed by your mail client, not by DataStage.
Which is exactly what I meant, should have been a teensy bit more specific it would seem. :wink:

Re: Unable to Attach large Files (20 MB) and above

Posted: Mon Jun 20, 2011 11:29 pm
by SURA
Change the approach.

In the After subroutine call shell script which can SCP to move the data to some specific server and then send the status email.

DS User