User define stage

[murari83.ds]

Hi All,

To count the row in table we are using the link out function.

we are using the basic transformer .

Job like:

Seqfile-------->Transformer-----------> seq file

In the Tranformer we are calling the Routine uning linkcount function.

can you please give me the idea how to call the same funtion using the user define stages like Buldops.

Thanks
Murari

[Sainath.Srinivasan]

Need more information on why you are using buildOps and what you are planning to do.

As the routine is a 'server' component and a buildOp is a C++ library, you may need to initiate a server call from each instance which in turn may call the routine. This will be quite complicated to manage - especially for performance.

[murari83.ds]

Need more information on why you are using buildOps and what you are planning to do.

As the routine is a 'server' component and a buildOp is a C++ library, you may need to initiate a server call fr ...

because of i am using the server job or basice transformer .

I am planing to used the parallel job. so that i am palning to use buildops job

[Sainath.Srinivasan]

Why not convert the routine into a parallel one or avoid calling it ?

[murari83.ds]

Why not convert the routine into a parallel one or avoid calling it ? ...

because we don't have a external object file to use in the project. So that I need to used code with in the stages.

[Sainath.Srinivasan]

I am a bit lost with that answer.

Do you mean to say that you are "writing a buildOp" which is a code but not interested in "writing the routine in parallel" !?

[murari83.ds]

I am a bit lost with that answer.

Do you mean to say that you are "writing a buildOp" which is a code but not interested in "writing the routine in parallel" !? ...

Instated of writing the parallel routine, I am interested to write a build ops like user define stage. suppose i need to write a routine i need crete a object file and call that routine in transformer.

eg:
Seq file -----> buildops stage------->seq fileer

seq file
columes:
jobname, stage name and link name
input
------
abc
xf
lk_xf

I need to calculate the link count of input file