DSXchange

I have job which is unloading the data from oracle and writing it to sequential file. Table have 5.6 million records ,my job is aborting at 5.3 million and giving me an error Export failed , output file full.

I looked into the ulimit which is 2 GB, my data is around 1 GB and even I have free disk space of 74969488.
I used dataset instead of sequential file,Job is aborting at 90,000 records.

I have the same design for another job and have 5.9 million records and worked fine. No issues with it.

Can anyone please help me to debug this issue ?

Thanks in advance.

Can you provide the exact, complete error message. This can give more insight to what is happening.

Error message is as below, when I use sequential file

Seqential_File_116,0: Export failed
Seqential_File_116,0: output file full

When I use dataset,

Write to dataset on [fd 15] failed [error 0] on node node1
Orchestrate was unable to write to any of the following files
file name
Block write failure

Thanks

A search on "Output file full" gave me 22 results.
The majority of them point to disk space filling up.

Or a ulimit issue... it's one or the other but more than likely you just ran out of space.

My admin made ulimit size to unlimited. My file size is over 1.9 GB, so what are the other options I got to do.

Please give any suggestions.

Thanks in Advance

Find somewhere to write the file where it won't run out of room. That or write it out in segments and move each out after you write each.