source program in external source stage

djoni · Post by **djoni** » Wed Nov 23, 2005 3:08 pm

What must the Source Program do in an External Source Stage?
djoni

ray.wurlod · Post by **ray.wurlod** » Thu Nov 24, 2005 2:23 am

It must generate rows of data that can be received, interpreted as one or more columns, and put onto the stage's output link.

For example, I have created an External Source stage to get data out of a UniVerse table. It invoked a shell script that

made sure environment variables were correctly set

changed to the project directory (just in case)

executed the uv command

tidied up the output of the uv command

djoni · Post by **djoni** » Thu Nov 24, 2005 8:01 am

ray.wurlod wrote:It must generate rows of data that can be received, interpreted as one or more columns, and put onto the stage's output link.

A sequential file (UNIX file) ?

djoni

ray.wurlod · Post by **ray.wurlod** » Fri Nov 25, 2005 12:19 am

No. The stage picks up its source from stdout of whatever command is executed. There ought to be no file involved (unless, as I did, you employ a shell script).