Page 1 of 1

FILE SET CREATION PROBLEM

Posted: Thu Jan 18, 2007 2:30 am
by adasgupta123
Hi All,

In one of my datastage jobs the final output is a file set.A dataset is a input here and after some transformation the fileset is created.

Though there are 8 nodes in the datastage server in only three nodes records are exported but in the other 5 nodes 0 records are exported.

The log message for one node is as follows:

STG_AIR_CMF_BALANCE_SRC_1,2: Export complete; 0 records exported successfully, 0 rejected.

Here STG_AIR_CMF_BALANCE_SRC is the job name.

Looking for your help.

Regards

Avik Dasgupta

Posted: Thu Jan 18, 2007 4:56 am
by kumar_s
Check if the file has reached 2GB limit. It its not, check with different Config file which has less number of nodes.
Was there any transformation that forces records to not match with the given metadata in fileset?
Check it by replacing a sequential file stage.

Posted: Thu Jan 18, 2007 5:01 am
by ArndW
What partitioning method did you choose for the fileset?

Posted: Thu Jan 18, 2007 7:45 pm
by ray.wurlod
My guess (like Arnd's) is that you have partitioned on a column (or columns) that have a skewed distribution (or maybe only five distinct values). This is something you need to check. If you want even distribution of rows, choose Round Robin partitioning (or Modulus, if it's a single integer sequence).