Regarding fixed length file
Posted: Tue Sep 18, 2012 9:01 am
Hi All,
We have requirements to load fixed length file format in our ETL environment and have found an issue which I don't know it is a file format issue or Data Stage issue or issue while FTPing the data into our landing area. Would require your inputs resolving it.
We have file with metadata like below
COL1 1 - 2
COL2 3 - 4
COL3 5- 6
Consider the records in the fixed length flat file are like below
AA CC
XXYY
DDFF
SSRRGG
When I view data after defining the metadata in sequential file stage some records get missed out like only following records are displayed or loaded
AA CC
SSRRGG
Other two records which doesnot have a value for the last column is missed out. When looked into the file for record 2 and 3 there are no spaces after the last character that instead cursor moves on to the next line. Is this a problem reading the record in DataStage? Is there an option to set NULL for the last column if the value is not available?
Have anyone come across such situation and let me know how we could resolve this issue?
Thanks in advance for your input.
Arvind
We have requirements to load fixed length file format in our ETL environment and have found an issue which I don't know it is a file format issue or Data Stage issue or issue while FTPing the data into our landing area. Would require your inputs resolving it.
We have file with metadata like below
COL1 1 - 2
COL2 3 - 4
COL3 5- 6
Consider the records in the fixed length flat file are like below
AA CC
XXYY
DDFF
SSRRGG
When I view data after defining the metadata in sequential file stage some records get missed out like only following records are displayed or loaded
AA CC
SSRRGG
Other two records which doesnot have a value for the last column is missed out. When looked into the file for record 2 and 3 there are no spaces after the last character that instead cursor moves on to the next line. Is this a problem reading the record in DataStage? Is there an option to set NULL for the last column if the value is not available?
Have anyone come across such situation and let me know how we could resolve this issue?
Thanks in advance for your input.
Arvind