DSXchange

I have to fetch last record from a file but i do not want to execute the stage in sequential mode.i want to execute stage in parallel mode only.


Current logic i am following.

sequentialfile-->tail stage

or

sequentail file-->transformer stage(lastrow function as constraint).



both tail stage and transfomer stage i am running in sequential mode but i am thinking whether we can do samething by using by executing the stage in parallel mode

Sure, if what you want is the last record FROM EVERY NODE

Thanks for reply but is it possible get last record only by executing stage in parallel mode and after that i can use some transformation to get last record alone from the file

Sure, if what you want is the last record FROM EVERY NODE.

In other words, no.

Is the purpose of the job to only get the last row of an input file?

If so, just use the unix cmd tail -1 on the filter in the sequential file stage.

You do not know, in a parallel execution environment, which node is processing the last row of the file, unless there is some particular characteristic of the data from that line that allows it to be thus identified.

Been wondering the same thing, all of this conversating about "last record alone" - if that's all you need just use tail -1 as noted and never mind about all this parallel mode stuff.

Oh, and... whatever happened to the "first record" you mentioned in your subject?