Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett , rschirm , roy
roydanlobo
Participant
Posts: 21 Joined: Mon Mar 01, 2010 4:55 pm
Post
by roydanlobo » Wed Dec 01, 2010 4:13 pm
I have job which is unloading the data from oracle and writing it to sequential file. Table have 5.6 million records ,my job is aborting at 5.3 million and giving me an error Export failed , output file full.
I looked into the ulimit which is 2 GB, my data is around 1 GB and even I have free disk space of 74969488.
I used dataset instead of sequential file,Job is aborting at 90,000 records.
I have the same design for another job and have 5.9 million records and worked fine. No issues with it.
Can anyone please help me to debug this issue ?
Thanks in advance.
narasimha
Charter Member
Posts: 1236 Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY
Post
by narasimha » Wed Dec 01, 2010 4:37 pm
Can you provide the exact, complete error message. This can give more insight to what is happening.
Narasimha Kade
Finding answers is simple, all you need to do is come up with the correct questions.
roydanlobo
Participant
Posts: 21 Joined: Mon Mar 01, 2010 4:55 pm
Post
by roydanlobo » Thu Dec 02, 2010 1:41 pm
Error message is as below, when I use sequential file
Seqential_File_116,0: Export failed
Seqential_File_116,0: output file full
When I use dataset,
Write to dataset on [fd 15] failed [error 0] on node node1
Orchestrate was unable to write to any of the following files
file name
Block write failure
Thanks
narasimha
Charter Member
Posts: 1236 Joined: Fri Oct 22, 2004 8:59 am
Location: Staten Island, NY
Post
by narasimha » Thu Dec 02, 2010 7:10 pm
A search on "Output file full" gave me 22 results.
The majority of them point to disk space filling up.
Narasimha Kade
Finding answers is simple, all you need to do is come up with the correct questions.
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Thu Dec 02, 2010 7:40 pm
Or a ulimit issue... it's one or the other but more than likely you just ran out of space.
-craig
"You can never have too many knives" -- Logan Nine Fingers
roydanlobo
Participant
Posts: 21 Joined: Mon Mar 01, 2010 4:55 pm
Post
by roydanlobo » Sat Dec 04, 2010 5:01 pm
My admin made ulimit size to unlimited. My file size is over 1.9 GB, so what are the other options I got to do.
Please give any suggestions.
Thanks in Advance
chulett
Charter Member
Posts: 43085 Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO
Post
by chulett » Sat Dec 04, 2010 5:37 pm
Find somewhere to write the file where it won't run out of room. That or write it out in segments and move each out after you write each.
-craig
"You can never have too many knives" -- Logan Nine Fingers