Output file full

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
roydanlobo
Participant
Posts: 21
Joined: Mon Mar 01, 2010 4:55 pm

Output file full

Post by roydanlobo »

I have job which is unloading the data from oracle and writing it to sequential file. Table have 5.6 million records ,my job is aborting at 5.3 million and giving me an error Export failed , output file full.

I looked into the ulimit which is 2 GB, my data is around 1 GB and even I have free disk space of 74969488.
I used dataset instead of sequential file,Job is aborting at 90,000 records.

I have the same design for another job and have 5.9 million records and worked fine. No issues with it.

Can anyone please help me to debug this issue ?

Thanks in advance.
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Post by narasimha »

Can you provide the exact, complete error message. This can give more insight to what is happening.
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
roydanlobo
Participant
Posts: 21
Joined: Mon Mar 01, 2010 4:55 pm

Post by roydanlobo »

Error message is as below, when I use sequential file

Seqential_File_116,0: Export failed
Seqential_File_116,0: output file full

When I use dataset,

Write to dataset on [fd 15] failed [error 0] on node node1
Orchestrate was unable to write to any of the following files
file name
Block write failure

Thanks
narasimha
Charter Member
Charter Member
Posts: 1236
Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY

Post by narasimha »

A search on "Output file full" gave me 22 results.
The majority of them point to disk space filling up.
Narasimha Kade

Finding answers is simple, all you need to do is come up with the correct questions.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Or a ulimit issue... it's one or the other but more than likely you just ran out of space.
-craig

"You can never have too many knives" -- Logan Nine Fingers
roydanlobo
Participant
Posts: 21
Joined: Mon Mar 01, 2010 4:55 pm

Post by roydanlobo »

My admin made ulimit size to unlimited. My file size is over 1.9 GB, so what are the other options I got to do.

Please give any suggestions.

Thanks in Advance
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Find somewhere to write the file where it won't run out of room. That or write it out in segments and move each out after you write each.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply