how to remove header and trailer from records.

[hitmanthesilentassasin]

try this in your filter option of either sequential file or cff.

Code: Select all

 sed '1d;$d' 

or

Code: Select all

 sed '/HDR/d; /TRL/d'

[asorrell]

Add a constraint to your transformer output links that prevents those rows from being output... something like:

InputLinkName.FirstColName[1,3] <> "HDR" and InputLinkName.FirstColname[1,3] <> "TRL"

[kaushal.kumar@igate.com]

try this in your filter option of either sequential file or cff.

Code: Select all

 sed '1d;$d' 

or

Code: Select all

 sed '/HDR/d; /TRL/d'

Hi Hitman,

Can you please help me out ,in sequential file where i can define sed '/HDR/d; /TRL/d' to remove header and trailer .Please advice

[hitmanthesilentassasin]

you have to define that in the filter option of the sequential file stage.

[kaushal.kumar@igate.com]

you have to define that in the filter option of the sequential file stage.

Hi HITMAN,

actually i will have two columns first column= filen name,second column=records detail.
i have to filter header and trailer from records column.
in my records column sample data will look like given above.
please advice

[ArndW]

If you google the UNIX "sed" command, you'll see that changing the suggest command to

Code: Select all

sed '1,2d;$d' 

should do the trick.

[kaushal.kumar@igate.com]

If you google the UNIX "sed" command, you'll see that changing the suggest command to

Code: Select all

sed '1,2d;$d' 

should do the trick. ...

my datastage server is in window..can i use unix command in this ?

[ArndW]

Windows DataStage servers come with the MKS Toolkit, which also includes the 'sed' command.

[chulett]

Define your file metadata to match your "detail" records and the others will be filtered automagically, assuming their record layout is different enough to be rejected by the stage.

[kaushal.kumar@igate.com]

Define your file metadata to match your "detail" records and the others will be filtered automagically, assuming their record layout is different enough to be rejected by the stage. ...

Hi chulett,

i dont have any metadata.i have records in single column.
i am using sequential file as input.which will have two column.
1 column repreasent file name
2 column represent records of particular file.
from this colmun i have to remove header and trailer.

[chulett]

OK, simple enough, then just use a contraint to filter out any records where the first three characters in your big field are "HDR" or "TRL".

[kaushal.kumar@igate.com]

OK, simple enough, then just use a contraint to filter out any records where the first three characters in your big field are "HDR" or "TRL". ...

Hi chulett,

please advice me .
i tried with dslink.column_name[1,3] <>'HDR' AND dslink.column_name[1,3] <>'TRL'.
as constraint.but its not working

[chulett]

<bzzzztttt> Sorry Andy, thanks for playing.

D'oh... where the heck did Andy go? Silly Wabbit.

Define 'not working', that looks perfectly fine to me. Are you sure you are checking the right 'column name'?

[asorrell]

Can you tell us HOW it isn't working? What happens?

[kaushal.kumar@igate.com]

<bzzzztttt> Sorry Andy, thanks for playing.

D'oh... where the heck did Andy go? Silly Wabbit.

Define 'not working', that looks perfectly fine to me. Are you sure you are checking the right 'column name'?

yah,problem is i have records in single column.
which contain header ,details and trailer.