extract header and footer info from fixed width file

snt_ds · Post by **snt_ds** » Tue May 05, 2009 6:43 am

Hi,

My requirement is:

Source: Fixed width file
Target:Fixed width file

Source file contains header and footer, i need to store that info into a table(staging), and include them while loading into target fixed width file.

Could anybody give me an idea how to proceed with this requirement?

Thanks in Advance,
snt_ds

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Tue May 05, 2009 7:13 am

How big is your input file ?

snt_ds · Post by **snt_ds** » Tue May 05, 2009 7:36 am

six extracts are there and in that 4 are like 100000 records.
2 of them are very big like 1300000

ShaneMuir · Post by **ShaneMuir** » Tue May 05, 2009 7:39 am

Do your input files have any values to identify headers and trailers or do you just want to get the first and last line of each file?

snt_ds · Post by **snt_ds** » Tue May 05, 2009 8:34 am

I need first line and last line for each file.

ShaneMuir · Post by **ShaneMuir** » Tue May 05, 2009 8:48 am

Well personally I would use a unix script to get the header and trailer records from the input files. (You could store them in a file or load them to a table).

I would then process the incoming files using a file pattern and a column name field and use an external target stage to generate variable file names.

Once you have finished processing you would write another unix script to append the header and trailer records back to their respective files.

nagarjuna · Post by **nagarjuna** » Tue May 05, 2009 8:49 am

Hi ,

Read the entire file in a varchar column and mention constraints in transformer directing header into one link , trailer into another link and rest of the data into 3rd link.

ShaneMuir · Post by **ShaneMuir** » Tue May 05, 2009 9:00 am

nagarjuna wrote:Hi ,

Read the entire file in a varchar column and mention constraints in transformer directing header into one link , trailer into another link and rest of the data into 3rd link.

How would you identify the header record and the trailer record?

nagarjuna · Post by **nagarjuna** » Tue May 05, 2009 9:22 am

Oh sorry ..Here i assumed that there are identifiers to identify the header and trailer records .

ShaneMuir wrote:
nagarjuna wrote:Hi ,

Read the entire file in a varchar column and mention constraints in transformer directing header into one link , trailer into another link and rest of the data into 3rd link.
How would you identify the header record and the trailer record?

snt_ds · Post by **snt_ds** » Wed May 06, 2009 8:28 am

Hi ShaneMuir ,

Could you tell me in more detail or If possible can you provide me the unix commands pls.

Sreenivasulu · Post by **Sreenivasulu** » Wed May 06, 2009 11:15 am

head filename
tail filename

snt_ds wrote:Hi ShaneMuir ,

Could you tell me in more detail or If possible can you provide me the unix commands pls.