Datasets issue

go4it · Post by **go4it** » Thu Dec 17, 2009 9:17 am

Hi,

I have a set of jobs that extracts data and write to a dataset, teh design is as follow

<sourceStage> ------> Copy Stage -----> Dataset Stage

The jobs works fine, but when I tried to run the job again after a couple of weeks later (i.e. today), The job finishes OK with lots of warnings, I checked the Director and found the following warning message as shown below

When checking operator: The modify operator keeps field "ColumnName" which is not present in the output interface.

I check the dataset, "dsrecords" the data is there but when I tried to view the dataset the schema is unavailable. I used Dataset management utility to check the data/schema and the schema is not populated but data is available in the nodes.

Please advice what needs to be done. Appreciate your quick responses.

Regards
C

chulett · Post by **chulett** » Thu Dec 17, 2009 9:33 am

So are you saying the that ".ds" descriptor file no longer exists? If so, you can remove the datasets manually and then rebuild everything by running the job again.

go4it · Post by **go4it** » Thu Dec 17, 2009 9:37 am

Chulett,

It is creating *.ds file.

I have tried to remove the files and rerun the job, still I am getting the issue.

Please advice.

Regards
C

chulett · Post by **chulett** » Thu Dec 17, 2009 10:05 am

Then you need to address the root cause of the error. Do an exact search for "The modify operator keeps field" and see if any of the matched posts help.

ray.wurlod · Post by **ray.wurlod** » Thu Dec 17, 2009 1:58 pm

Is runtime column propagation (RCP) enabled or disabled?