Sort function

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
muruganr117
Participant
Posts: 40
Joined: Sun Jan 21, 2007 1:52 pm
Location: Chennai
Contact:

Sort function

Post by muruganr117 »

Hi ,

I would like to know whether there is any specific UNIX sort command which will sort huge files.say for ex : 2GB or more size of file. Each record in file is 16747 in length. We have tried with UNIX command sort -S , but it is failing for huge data files. I saw in UNIX man , there is large file option. But i was not able to find the command for operation with largefiles. Could you please help me in the same.

Thank you well in advance...

regards
Murugan R
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Talk to your SAs or whomever supports UNIX there. You'll need to up the 'memory' options and probably point to a larger 'tmp' area, from what I recall.
-craig

"You can never have too many knives" -- Logan Nine Fingers
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Large files require large tmp space. You can specify a temporary diretor using the -T option. Read about it in unix sort manual pages.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
Post Reply