how to skip first 4 records

somu_june · Post by **somu_june** » Mon Mar 20, 2006 10:56 pm

Hi,

I want to skip four records. I tried with @INROWNUM and I gave columm name for @INROWNUM as linenum. I got numbers 1 to 24 . I want to take record from linenum 5 so in transformer constraint I gave linenum>=5 but Iam getting only 5 records i.e linenum 5 to 9 but I want records from 5 to the end i.e 24 in this condition . How to achieve his ,plz help me.

Thanks,
Somaraju.

rasi · Post by **rasi** » Mon Mar 20, 2006 11:09 pm

Somu

What is your source?. Are you executing your job in parallel mode or sequential mode?

Easiest way is to change your job to run in sequential mode and have the constraint as @INROWNUM >=5

Thanks

chulett · Post by **chulett** » Mon Mar 20, 2006 11:13 pm

Isn't there a property in the PX Sequential File stage to skip the first X records?

Seem to recall that...

rasi · Post by **rasi** » Mon Mar 20, 2006 11:31 pm

Craig

I don't think that there is an option to skip first N rows in PX Sequential Stage. I do remember that there is an option to Read First N Rows in PX Sequential stage...

chulett · Post by **chulett** » Mon Mar 20, 2006 11:44 pm

Perhaps that's what I was thinking of.

ray.wurlod · Post by **ray.wurlod** » Mon Mar 20, 2006 11:45 pm

There's a Skip option in View Data but not, I believe, in the Sequential File stage.

Do you want to skip four records per partition, or four records in total? Is your source a text file or a database table or some other source?

rasi · Post by **rasi** » Mon Mar 20, 2006 11:51 pm

Guys

Had a quick look in the Parallel Developer Guide Manual and found that not all options for Sequential stage is described inside the manual. It seems that we need to browse the real object to see all the options available for a stage.

ray.wurlod · Post by **ray.wurlod** » Mon Mar 20, 2006 11:57 pm

There's a lot of that. That's why it's useful (vital) to have the Orchestrate manuals available also.

daniel0623 · Post by **daniel0623** » Tue Mar 21, 2006 2:38 am

Hi somu_june,
It seems datastage can't skip first N rows.But we can read all rows firstly,then filter by Filter Stage.

You may choose Row Number Column in Sequential File Stage's Properties page.Name a value,such as RowNum.Add a column with same name in Columns page. SQL type:Integer .Then we can get real row num.Pay attention,this value will start with 0.

Now you can filter first 4 rows in Filter Stage.Just type RowNum > 4 when output.

By the way,System variable @INROWNUM can't indicate the real row number of file when DSEE has more than 1 partition.It just shows row num in every partition.Good luck!

kumar_s · Post by **kumar_s** » Tue Mar 21, 2006 7:56 am

May be possible if dont really want to stick with Sequential stage. And the provide the input file is Sequential Flat file.
You can use Head stage. Where you have option to 'Skip n rows per partiton. Also that you have option to read N rows.
Also make sure the partion is made to single. Either by Forcing in sequential mode or by including a APT_CONFIG_FILE paramter with one node.

somu_june · Post by **somu_june** » Tue Mar 21, 2006 10:34 am

Hi,

Thank you every one for helping me.

Thanks,
Somaraju

mpouet · Post by **mpouet** » Wed Mar 22, 2006 9:51 am

Hi,

Why don't you use a UNIX command in a before job subroutine ?
tail +5 yourfile > newfile

Bye
Matthieu

dmalsobrook · Post by **dmalsobrook** » Tue Oct 01, 2013 10:13 am

Hello Somaraju and others,

I know this is old but was this issue ever solved? I have the same problem.

Thank you.

prasson_ibm · Post by **prasson_ibm** » Tue Oct 01, 2013 12:22 pm

There could be possibly workaroud, if your source is sequential file then you can generate sequence nunumber and then in transformer constraint give condition like seqno> 4

rsomiset · Post by **rsomiset** » Tue Oct 01, 2013 4:31 pm

Row number column in the options category can be used to generate row numbers if required...using which we can filter in subsequent stages.

DSXchange

how to skip first 4 records

how to skip first 4 records

Did anyone ever figure this out?