I have the below requirement. I have already designed a job to load the header & footer information in a log file. The job will be used as a template for all the process. The job will take the filename as the input and split the header & footer and then insert them into an etl_log table.
We may receive 4 or 5 files every month. We have to process the header and footer information before the actual loading process. Basically i have to run the job (which i designed to load the header & footer) 4 or 5 times with different file name.
So i have designed a job as below.
Code: Select all
ExecuteCommand ---> Start Loop ---> Job Activity ---> EndLoop
^ V
| |
---------------------------------------
Execute Command:
Command = ls sec*.txt
(Note the file name starts with "sec")
Parameter = #InputFileDirectory#
PROCESS_HDR_FTR..JobControl (@Execute_Command_0): Executed: ls sec*.txt /bis_data/input/
Reply=2
Output from command ====>
ls: sec*.txt: No such file or directory
/bis_data/input/:
ai.backup
deleteit.csv
perl-date-calc.txt.pl
perlout.log
sample.txt
sec_fund_data_with_names.txt
sec_fund_data_with_names_short_names.txt
sec_fund_returns.txt
sec_fund_returns_WITH_EXP.txt
sec_index_returns_names.txt
Start Loop:
Loop Type: List Loop
Loop Definition: #Execute_Command_0.$CommandOutput#
Delimeter : Comma
I just captured the below information from the director log.
PROCESS_HDR_FTR..JobControl (@Job_Activity_2): Controller problem: Error calling DSSetParam(FileName), code=-4
[ParamValue/Limitvalue is not appropriate]
PROCESS_HDR_FTR..JobControl (@Coordinator): Summary of sequence run
02:52:01: Sequence started
02:52:01: Execute_Command_0 (COMMAND ls sec*.txt) started
02:52:01: Execute_Command_0 finished, reply=2
02:52:01: StartLoop_Activity_1 loop iteration 1 started
02:52:01: Job_Activity_2 (JOB AI_00_GET_HDR_FTR) started
02:52:01: Exception raised: @Job_Activity_2, Error calling DSSetParam(FileName), code=-4 [ParamValue/Limitvalue is not appropriate]
02:52:01: Sequence failed
Can you help me to resolve this issue?