How to get source file's name into a transformer?

[mmartin]

Hi,
I have a sequential file in source, which name is like FILENAME_YYYYMMDD.
I want to get the "YYYYMMDD" part of the filename in order to load it in a table.
Do you have any idea please?

Thanks in advance.

[chulett]

Been discussed a number of times, here is one example.

[DSguru2B]

Do it at the OS level. Do a

Code: Select all

ls <dir path>| grep "FILENAME" | awk -F"\_" '{print $2}' > result.txt

Now you have that name in a file. Read it in your job and load it in the table. You can run this command in the before job subroutine 'ExecSH'

[kcbland]

Easiest way to do this is on initialization of a Stage Variable in a Transformer. Write a DS Function to do a CALL DSExecute and run the command to get the filename and format the results. This will only be done once when the stage starts. Set the derivation of the stage variable to itself (FRED = FRED). Now just use the stage variable where desired.

[chulett]

Set the derivation of the stage variable to itself (FRED = FRED).

Actually, just leave it blank.

[trobinson]

I get the impression Mr. Bland is referring to a Server job. Seems like overkill to get the filename in a EE job. Why not add the property File Name Column in the Sequential stage?

[kcbland]

I get the impression Mr. Bland is referring to a Server job.

Did I give a Server answer to a PX question again?

[chulett]

Doh!

[kcbland]

You know, you just sit and read thru about 20 Server posts, then a PX one comes thru and you don't mentally switch gears. It's not like I'm switching between here and other work at the same time

[kcbland]

PX Sequential stage can put the name of the file(s) into a column you specify. You'll have to trim off the unwanted bits to keep just the date portion and then cast it into a properly typed column.

[mmartin]

I tried to use File Name Column option in the sequential stage with a Read Method set to File Pattern and using a wildcard for my filename as FILENAME* (where my real file name is still FILENAME_YYYYMMDD).

Then I get this result in the output column "FILENAME*". I wonder why it returns me the wildcard, because I want to catch the date instead of the wildcard!!!!

Thank you all.

[chulett]

Did you read the post I linked to? Did you try everything noted there, including setting APT_IMPORT_PATTERN_USES_FILESET to TRUE?

[mmartin]

Did you read the post I linked to? Did you try everything noted there, including setting APT_IMPORT_PATTERN_USES_FILESET to TRUE? ...

You're right, it works fine!!!!

Thank you very much.