can target dataset preserve pre sorted data?

tverma27 · Post by **tverma27** » Mon May 04, 2009 2:19 am

Hi

In my project we are doing Sorting on some business columns and want to load the sorted data in a dataset.

But my concern is since input data will move to different nodes of the dataset, Will the sorting remain preserved in the dataset?

Thanks in advance!

mahadev.v · Post by **mahadev.v** » Mon May 04, 2009 2:54 am

Sorting and partition of the data can be maintained in a DataSet. Use Same partition on the DataSet input link. As long as you are not repartitioning the sorted data this would work.

tverma27 · Post by **tverma27** » Mon May 04, 2009 3:12 am

Thanks for your quick reply
i am doing a database sorting so will SAME partition help?

mahadev.v · Post by **mahadev.v** » Mon May 04, 2009 4:17 am

Might work. Data would get repartitioned but the sort order in each partition should remain.

stefanfrost1 · Post by **stefanfrost1** » Mon May 04, 2009 5:52 am

Depends on which database (stage) and read method you are using. If you're not reading data from each database partition(node) your data will be returned on a single node and thereby your dataset will remain as a single node when using SAME partitioning.

Using DB2EE-stage for example and read method table would return data on as many nodes as your db is configured on and using db2 hash algoritm, so using SAME partitioning in this case would preserve your sort and partitioning as from the db.

ray.wurlod · Post by **ray.wurlod** » Mon May 04, 2009 4:21 pm

Repartitioning will, as a general rule, destroy any sorting (which is per-partition).