Reading Data Through Dataset

ntr · Post by **ntr** » Wed Aug 01, 2012 3:02 am

hi,

i have a dataset with 1,00,000 records. is it possible to read only 2,000

records from that at the time of reading??

Thanks

ArndW · Post by **ArndW** » Wed Aug 01, 2012 3:30 am

No, the dataset stage does not have that option. You would need to put a stage right after the read. I know that a Transform stage with the constraint "@INROWNUM < 2000" (in a 1-node configuration) would work, but there should be some other more efficient way that I can't think of right now.

ntr · Post by **ntr** » Wed Aug 01, 2012 4:00 am

ok Thanks ArndW

BI-RMA · Post by **BI-RMA** » Wed Aug 01, 2012 6:21 am

Under the Debug / Development-Tab there are the two stages Head and Tail. You can use them to limit the number of rows sent downstream, either from the top or the bottom of the heap (like Unix-commands).

bhasds · Post by **bhasds** » Wed Aug 01, 2012 8:04 am

In transform stage @PARTITIONNUM + (@NUMPARTITIONS * (@INROWNUM - 1)) + 1 <2001(in multiple node Configuration file) should work fine.