FILE SET CREATION PROBLEM

adasgupta123 · Post by **adasgupta123** » Thu Jan 18, 2007 2:30 am

Hi All,

In one of my datastage jobs the final output is a file set.A dataset is a input here and after some transformation the fileset is created.

Though there are 8 nodes in the datastage server in only three nodes records are exported but in the other 5 nodes 0 records are exported.

The log message for one node is as follows:

STG_AIR_CMF_BALANCE_SRC_1,2: Export complete; 0 records exported successfully, 0 rejected.

Here STG_AIR_CMF_BALANCE_SRC is the job name.

Looking for your help.

Regards

Avik Dasgupta

kumar_s · Post by **kumar_s** » Thu Jan 18, 2007 4:56 am

Check if the file has reached 2GB limit. It its not, check with different Config file which has less number of nodes.
Was there any transformation that forces records to not match with the given metadata in fileset?
Check it by replacing a sequential file stage.

ArndW · Post by **ArndW** » Thu Jan 18, 2007 5:01 am

What partitioning method did you choose for the fileset?

ray.wurlod · Post by **ray.wurlod** » Thu Jan 18, 2007 7:45 pm

My guess (like Arnd's) is that you have partitioned on a column (or columns) that have a skewed distribution (or maybe only five distinct values). This is something you need to check. If you want even distribution of rows, choose Round Robin partitioning (or Modulus, if it's a single integer sequence).