Output file full

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
anu123
Premium Member
Premium Member
Posts: 143
Joined: Sun Feb 05, 2006 1:05 pm
Location: Columbus, OH, USA

Output file full

Post by anu123 »

Helo all,

I am trying to full outer join 2 seq. files ( each contains approx. 30 mil. rows ). My job looks as below..

File_2
|
|
file_1------Join -- Trans-----Seq.File.

Job is getting aborted with following errors...


Copy_of_Merge_file,0: Export failed.

Copy_of_Merge_file,0: Output file full

Copy_of_Merge_file,0: Failure during execution of operator logic.

Copy_of_Merge_file,0: Fatal Error: No file descriptor was supplied.
node_apsp8014B: Player 5 terminated unexpectedly.
main_program: Unexpected exit status 1


I tried to search with 'output file full' but could not find any relevent post.
Thank you,
Anu
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

I did an exact search on 'output file full' and it returned me 8 posts. Try searching again.
The error is pretty much what it says, your output file is full. Your hitting the 2GB limit. Its, but, obvious. A full outer join of 30M to 30M. :?
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Do a search on 'output file full' and Exact match. Check for disck space usage of target directory and temp directory as well.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Post Reply