DSXchange

Hi

In my project we are doing Sorting on some business columns and want to load the sorted data in a dataset.

But my concern is since input data will move to different nodes of the dataset, Will the sorting remain preserved in the dataset?


Thanks in advance!

Sorting and partition of the data can be maintained in a DataSet. Use Same partition on the DataSet input link. As long as you are not repartitioning the sorted data this would work.

Thanks for your quick reply
i am doing a database sorting so will SAME partition help?

Might work. Data would get repartitioned but the sort order in each partition should remain.

Depends on which database (stage) and read method you are using. If you're not reading data from each database partition(node) your data will be returned on a single node and thereby your dataset will remain as a single node when using SAME partitioning.

Using DB2EE-stage for example and read method table would return data on as many nodes as your db is configured on and using db2 hash algoritm, so using SAME partitioning in this case would preserve your sort and partitioning as from the db.

Repartitioning will, as a general rule, destroy any sorting (which is per-partition).