How to populate filename to column name in the table

[sreewin7]

Hi Floks,

I have a requirement, my source is sequential files and they want to populate filename to target table one of the column.
Provide me some logic to fulfill this requirement.

Request you to please help me to slove this issue.

Thanks
Sree

[SURA]

Try with APT_IMPORT_PATTERN_USES_FILESET.

[Kryt0n]

As with what SURA said (if you are trying to use wildcard consumption) and within the sequential file stage, define a column to hold the filename and use the option on the sequential file stage along the lines of "Filename column"

[ray.wurlod]

Don't believe that's possible in a Server job.

[sreewin7]

Thanks very much everyone.

I tried everything , if any one did in server job, please help me.

Regards,
Sree

[ray.wurlod]

Make the file name a job parameter. Use that parameter in the Sequential File stage. Populate the "FileName" output column of a Transformer stage using the same job parameter. Of course, this only works for a single file, but you can use a sequence to loop through a set of file names.

[SURA]

I am not aware that variable is not for Server jobs. I am sorry for that; but did you try to add that variable in the job level and make the default value to 1?

Just interested to see what is a happening?

[ray.wurlod]

Any environment variable with APT_ at the beginning of its name applies to the Orchestrate engine (and therefore to parallel jobs only). The same goes for environment variables whose name begins with OSH_.

APT comes from "Applied Parallel Technologies", the name of the company that invented the parallel engine technology before they became Torrent Systems, which was acquired by Ascential Software in about 2003.

[SURA]

Hi Ray

Thanks for the clarification. Now i understood.

[sreewin7]

Thanks every, still my issues is not resolved.

Is any other way to finish this task.

[chulett]

What about Ray's advice? Are you not passing in the filename to read as a job parameter? If so, simply leverage that in the appropriate column.

[sreewin7]

Thanks, here my situation is not static it is dyamically changes for every file.
Kindly advice.

Thanks
Sree

[chulett]

Of course, no-one assumed it was static. Answer this: how does the job know what filename to use each time it runs? Is the current filename passed in as a job parameter or are you using some other mechanism?

[SURA]

How you are going to get the file names?

OR

Every day set of files will be placed in the folder and need to load that?

Is that all the files to the same table / different tables?

So lot of questions behind this!

Though, there are different ways to handle this!

You can use Sequence / routine to achieve this.

You can search for server routine loop / basic code loop and use that to achieve that.

If you are not good with routine, then go for sequence.

Code: Select all

1)cmd activity stage-->2)StartLoop-->3)GetFileName-->4)JobToLoadData-->5)EndLoop

You can use the Unix commands to find out how many jobs you are going to use to run? That count can be the loop counter.

What you have tried so far?

What is your approach?

share with us. Some one will fine tune / correct it

[sreewin7]

chulett
-Sorry for not providing full description.
SURA
- Yes, they are posting total files along with trigger file in one folder ,based on the module.
And i am trying with your logic, and update the status.
Ray -Thanks for your clarification and Thanks every one.

Regards,
Sree