Reg. Sort command in Windows

Naveen · Post by **Naveen** » Fri May 04, 2007 10:47 am

Hi,

As we were using Sort stage in job for processing more than 10 lakh records. Its taking huge time(4-5 hours). Performance was very poor because of this.Our DS server is windows. pls provide the sort command for a delimited file in DOS. So that we ll try using this command in Before stage routine. Hope it ll increase the performance by using this command.

DSguru2B · Post by **DSguru2B** » Fri May 04, 2007 10:48 am

What is your source? Is it a flat file or a database?

Naveen · Post by **Naveen** » Fri May 04, 2007 12:00 pm

DSguru2B wrote:What is your source? Is it a flat file or a database?

It's flat file only..

DSguru2B · Post by **DSguru2B** » Fri May 04, 2007 12:58 pm

Check here.

Naveen · Post by **Naveen** » Sat May 05, 2007 11:34 am

DSguru2B wrote:Check here.

Hi DSGURU,

In this link i didn't find any option for delimiter. I want to sort delimiter file in DOS. i have searched in google. Pls provide me the syntax of SORT command in DOS for a delimited file.

chulett · Post by **chulett** » Sat May 05, 2007 3:17 pm

All MS-DOS commands have help built-in. Open a command prompt in Windows - Start / Run / cmd - and then type the command followed by /?:

Code: Select all

sort /?
SORT [/R] [/+n] [/M kilobytes] [/L locale] [/REC recordbytes]
  [[drive1:][path1]filename1] [/T [drive2:][path2]]
  [/O [drive3:][path3]filename3]
  /+n                         Specifies the character number, n, to
                              begin each comparison.  /+3 indicates that
                              each comparison should begin at the 3rd
                              character in each line.  Lines with fewer
                              than n characters collate before other lines.
                              By default comparisons start at the first
                              character in each line.
<snip everything else>

You'll get all the options that exist for the command. You didn't find a delimiter option for sort because there isn't one. If you really want to use the DOS command, you'll need to convert your delimited file to fixed-width and then use the /+n option.

At that point, you might as well use the Sort stage.

ray.wurlod · Post by **ray.wurlod** » Sat May 05, 2007 3:23 pm

The Sort stage in server jobs is universally acknowledged to be horrible. I'd suggest getting a UNIX emulator for Windows, such as MKS Toolkit or Cygwin, and using the sort command therein.

chulett · Post by **chulett** » Sat May 05, 2007 3:48 pm

Granted, but it's the only alternative that doesn't require an outlay of cash.

Curious, would the DOS sort command be any better? I doubt it, but have nothing to base that opinion on.

ray.wurlod · Post by **ray.wurlod** » Sat May 05, 2007 5:00 pm

With neither statistics nor knowledge of the internal sort algorithms available to me, I feel it would be unwise to offer an opinion.