How the DS Process works?

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It's an unusual design.
You control when rows are committed; if you specify 1000 rows per transaction, then a COMMIT is sent for every 1000 rows arriving in stage A-orac8i.
All 10000 rows are processed into the Oracle table before the output link of A-orac8i is opened and its SELECT statement executed. Therefore, the ORDER BY clause will be applied to the entire result set of the SELECT statement.
If you're doing this purely to sort the data in the sequential file, why not investigate using either an operating-system sort facility (such as sort on UNIX), or a third party sort utility such as CoSort or SyncSort? (See www.datastagexchange.com for the CoSort plug-in for DataStage.)


Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518
mihai
Participant
Posts: 30
Joined: Thu Mar 13, 2003 5:24 am
Location: Hertfordshire

Post by mihai »

quote:Originally posted by Ray.Wurlod
[If you're doing this purely to sort the data in the sequential file, why not investigate using either an operating-system sort facility (such as sort on UNIX), or a third party sort utility such as CoSort or SyncSort? (See www.datastagexchange.com for the CoSort plug-in for DataStage.)


Free Intel versions of the sort utility (as well as some other goodies like cat, sed and tr) are available from the net.

Mihai

_________________________
desk direct:+441908448571
ariear
Participant
Posts: 237
Joined: Thu Dec 26, 2002 2:19 pm

Post by ariear »

There's a MICROSOFT product called SFU(services For Unix) that is almost full unix tools on 386. I think that MICROSOFT is going to integrate it in windows server 2003. Works very nice
Post Reply