Complex Flat File
Posted: Mon Feb 18, 2008 6:56 am
We are using Information Server 8.0.1 Parallel Extender. We have a requirement of loading the rows with same RECORD_ID into single table,i.e., Records with ABCDEF (RECORD_ID) should be loaded into table ABCDEF & GHIJKL should be loaded into the table GHIJKL & so on.
The INPUT FILE is FIXED WIDTH that has spaces right padded. All records are of same length with 250 characters in total with no field delimeter. Also, input file contains records of varying metadata across different RECORD_IDs. Records are identified by first 6 digit word RECORD_ID.
*********************************** FILE LAYOUT ***********************************
ABCDEF1617029211081283942348328
GIJKLM4545237534853483896389068386954905349
ABCDEF8779079808088070788088988
NOPQRS98909797908890
*********************************** FILE LAYOUT ***********************************
In the above FILE LAYOUT sample, ABCDEF, GIJKLM, NOPQRS are the RECORD_IDs through which the record can be identified. These records will have different metadata.All the records starting with same record-id will have the same metadata, so needs to be loaded to the same table.
For this, we have used a complex flat file. We defined the record constraints in the job as 'ABCDEF', 'GHIJKL', 'NOPQRS'. When we tried to view the data, the same recordid ( ABCDEF ) for all the output links of the complex flat file. But, we need to see only the data related to 'ABCDEF' if we specify the RECORD_ID constraint as 'ABCDEF' & so on. Request someone to point out in case we did anything wrongly & suggest a way to correct the same using a CFF.
The INPUT FILE is FIXED WIDTH that has spaces right padded. All records are of same length with 250 characters in total with no field delimeter. Also, input file contains records of varying metadata across different RECORD_IDs. Records are identified by first 6 digit word RECORD_ID.
*********************************** FILE LAYOUT ***********************************
ABCDEF1617029211081283942348328
GIJKLM4545237534853483896389068386954905349
ABCDEF8779079808088070788088988
NOPQRS98909797908890
*********************************** FILE LAYOUT ***********************************
In the above FILE LAYOUT sample, ABCDEF, GIJKLM, NOPQRS are the RECORD_IDs through which the record can be identified. These records will have different metadata.All the records starting with same record-id will have the same metadata, so needs to be loaded to the same table.
For this, we have used a complex flat file. We defined the record constraints in the job as 'ABCDEF', 'GHIJKL', 'NOPQRS'. When we tried to view the data, the same recordid ( ABCDEF ) for all the output links of the complex flat file. But, we need to see only the data related to 'ABCDEF' if we specify the RECORD_ID constraint as 'ABCDEF' & so on. Request someone to point out in case we did anything wrongly & suggest a way to correct the same using a CFF.