Sort stage

subrat · Post by **subrat** » Wed Jun 17, 2009 1:24 am

Hi,

I am using a shared container in a Job. In the shared container the source file is taking from a shared path and doing the sort in sort stage on next
stage.
After job running some time when i saw the monitor through DS director its showing some 32670000 no. records reading to sort stage in container and no records as output. when job didnt move beyond this, i rerun the job again. After reading same number of records through sort, job again hanged on that point. I suspect the the space might be the issue in sort stage, but there are enough space in temp area.

Need sugg. what might be the problem for this.

ArndW · Post by **ArndW** » Wed Jun 17, 2009 1:36 am

If you had run out of space the job would have aborted. Have you monitored the system while the job is running - particularly disk IO and CPU usage? When the job "hung", how did you stop it?

Large sorts can take a long time...

ray.wurlod · Post by **ray.wurlod** » Wed Jun 17, 2009 1:37 am

Have you specified a particular temporary directory pathname in the Sort stage?

With that many rows there will be a substantial delay between the final row being read from import and the first row being output, because the actual sort needs to happen in between. Are you, perhaps, merely being impatient?

Can you sort the file using a UNIX sort, to get some idea of how much time might be required? The server Sort stage is less efficient than the UNIX sort command, so will take longer.

chulett · Post by **chulett** » Wed Jun 17, 2009 6:54 am

In other words, be patient. The Server Sort stage is not the speediest animal on the planet.

ray.wurlod · Post by **ray.wurlod** » Wed Jun 17, 2009 4:12 pm

That would be the ambiguous puzuma.

chulett · Post by **chulett** » Wed Jun 17, 2009 4:26 pm

Yes, but not on this world.

ray.wurlod · Post by **ray.wurlod** » Wed Jun 17, 2009 4:34 pm

Douglas Adams wrote:If you try and take a cat apart to see how it works, the first thing you have on your hands is a non-working cat.

This is wrong. The first thing you'll have on your hands is a number of severe wounds from cat claws.