DataSet error

[srimitta]

Hi All,

I was able to create DataSet sucessfully but while reading I have below error and when I checked EFFECTIVE_FROM_DATE is existing.

Error executing View Data command:

##E IIS-DSEE-TOPK-00007 11:15:06(008) <_PEEK_IDENT_> Input dataset does not have field: "EFFECTIVE_FROM_DATE".

Any idea where I am going wrong.

Thanks
srimitta

[ray.wurlod]

Use the Data Set Management tool to verify that this column is, indeed, in the record schema associated with the Data Set (that is, rather than in the record schema associated with the link with which you are attempting to read from the Data Set).

[srimitta]

Thanks Ray for the response, would you please help me with little bit more info

(that is, rather than in the record schema associated with the link with which you are attempting to read from the Data Set).

[ray.wurlod]

In the generated OSH you will see that each operator (stage, simplisitically) gets its input(s) from, and writes its output(s) to, a virtual Data Set, whose control file name has a suffix of ".v". Associated with these operators is the record schema that it processes. It is that that I asked to see.

[srimitta]

Hi Ray, It is not that I want to trouble you by pasting job OSH, but I am trying to make sense out-of it where I am going wrong.

Below is the OSH from 3 source DataSet's in the job and I find EFFECTIVE_FROM_DATE is existing.

Any idea how can I fix this error.

Code: Select all

#################################################################
#### STAGE: Copy_of_Postal_Address_DS
## Operator
copy
## General options
[ident('Copy_of_Postal_Address_DS')]
## Inputs
0< [ds] '/devl/data/bi/w1/ds/dw1/unld/Postal_Address.ds'
## Outputs
0> [modify (
  POSTAL_ADDRESS_ID:not_nullable int32=POSTAL_ADDRESS_ID;
  TYPE_ID:not_nullable int32=TYPE_ID;
  ADDRESS_LINE_1_TEXT:nullable string[60]=ADDRESS_LINE_1_TEXT;
  ADDRESS_LINE_2_TEXT:nullable string[60]=ADDRESS_LINE_2_TEXT;
  ADDRESS_LINE_3_TEXT:nullable string[60]=ADDRESS_LINE_3_TEXT;
  CITY_NAME:not_nullable string[60]=CITY_NAME;
  FIPS_COUNTY_NUMBER:nullable decimal[5,0]=FIPS_COUNTY_NUMBER;
  STATE_ABBREVIATION:not_nullable string[2]=STATE_ABBREVIATION;
  ISO_COUNTRY_CODE:not_nullable string[3]=ISO_COUNTRY_CODE;
  POSTAL_CODE:nullable string[20]=POSTAL_CODE;
  POPULATION_INFO_ID:not_nullable int32=POPULATION_INFO_ID;
  EFFECTIVE_FROM_DATE:not_nullable date=EFFECTIVE_FROM_DATE;
  EFFECTIVE_TO_DATE:not_nullable date=EFFECTIVE_TO_DATE;
  VALID_FROM_TS:not_nullable timestamp=VALID_FROM_TS;
  VALID_TO_TS:not_nullable timestamp=VALID_TO_TS;
)] 'Copy_of_Postal_Address_DS:Lnk_Postal_Address.v'
;

#################################################################
#### STAGE: Copy_of_Channel_Role_DS
## Operator
copy
## General options
[ident('Copy_of_Channel_Role_DS')]
## Inputs
0< [ds] '/devl/data/bi/w1/ds/dw1/unld/Channel_Role.ds'
## Outputs
0> [modify (
  CHANNEL_ROLE_ID:not_nullable int32=CHANNEL_ROLE_ID;
  TYPE_ID:not_nullable int32=TYPE_ID;
  ROLE_PLAYER_ID:not_nullable int32=ROLE_PLAYER_ID;
  CHANNEL_RP_ID:nullable int32=CHANNEL_RP_ID;
  MAILING_POSTAL_ADDRESS_ID:not_nullable int32=MAILING_POSTAL_ADDRESS_ID;
  PRIMARY_LOB_ID:nullable int32=PRIMARY_LOB_ID;
  EXTERNAL_REFERENCE_TEXT:nullable string[50]=EXTERNAL_REFERENCE_TEXT;
  STATUS_CODE_ID:not_nullable int32=STATUS_CODE_ID;
  STATUS_REASON_CODE_ID:not_nullable int32=STATUS_REASON_CODE_ID;
  STATUS_DATE:not_nullable date=STATUS_DATE;
  UW_AUTHORITY_START_DATE:nullable date=UW_AUTHORITY_START_DATE;
  AGENCY_REFERENCE_STATE_NUMBER:nullable string[2]=AGENCY_REFERENCE_STATE_NUMBER;
  AGENCY_REFERENCE_NUMBER:nullable string[4]=AGENCY_REFERENCE_NUMBER;
  INDEPENDENCE_CATEGORY_NAME:nullable string[20]=INDEPENDENCE_CATEGORY_NAME;
  FULL_NAME:nullable string[60]=FULL_NAME;
  POPULATION_INFO_ID:not_nullable int32=POPULATION_INFO_ID;
  EFFECTIVE_FROM_DATE:not_nullable date=EFFECTIVE_FROM_DATE;
  EFFECTIVE_TO_DATE:not_nullable date=EFFECTIVE_TO_DATE;
  VALID_FROM_TS:not_nullable timestamp=VALID_FROM_TS;
  VALID_TO_TS:not_nullable timestamp=VALID_TO_TS;
)] 'Copy_of_Channel_Role_DS:Lnk_Channel_Role.v'
;


#################################################################
#### STAGE: Type_DS
## Operator
copy
## General options
[ident('Type_DS')]
## Inputs
0< [ds] '/devl/data/bi/w1/ds/dw1/unld/Type.ds'
## Outputs
0> [modify (
  TYPE_ID:not_nullable int32=TYPE_ID;
  PARENT_TYPE_ID:nullable int32=PARENT_TYPE_ID;
  TYPE_NAME:nullable string[60]=TYPE_NAME;
  TYPE_DESCRIPTION:nullable string[max=254]=TYPE_DESCRIPTION;
  POPULATION_INFO_ID:not_nullable int32=POPULATION_INFO_ID;
  EFFECTIVE_FROM_DATE:not_nullable date=EFFECTIVE_FROM_DATE;
  EFFECTIVE_TO_DATE:not_nullable date=EFFECTIVE_TO_DATE;
  VALID_FROM_TS:not_nullable timestamp=VALID_FROM_TS;
  VALID_TO_TS:not_nullable timestamp=VALID_TO_TS;
)] 'Type_DS:Lnk_Type.v'
;

Thanks
srimitta

[throbinson]

Are you aware that the schema and config file for a dataset is stored within the .ds? irrespective of the job that reads it? You need to check, via the Dataset Management tool in Manager, that the .ds contains EFFECTIVE_DATE.

[srimitta]

I checked Data Set management / Schema Window and APT Configuration file in Output, EFFECTIVE_FROM_DATE is existing in all.

Any idea


FYI:
In DataStage v8.0 IBM is not offering DataStage Manager client component, IBM moved all Manager functionality to DataStage Designer.