Set Job parameters using unix script

kranthi · Post by **kranthi** » Mon Oct 15, 2007 1:01 pm

Hi,

I am trying to set job parameters using unix script in a before-job subroutine. Can anyone please suggest what should I use in my scrip to set job parameters dynamically?

Here I the script I am running right now, but encountering with an error.

DSSetParam(PJ_OCC_EVE_ETL_commcommunicatn, "insert_cnt", "cat "$1" | grep 'insert_cnt">.*<' | cut -d">" -f4 | cut -d"<" -f1")

I am basically trying to grab the insert_cnt value from my xml file into job parameter insert_cnt.

I used this command in the before-job subroutine:

sh #Base_Path#xmlcount.sh #Base_Path#t_comm_communicatn_COUNT_INCR_20070924080734.xml

Base path is the location of all my files.

Any help is appreciated.

Thanks,
KK

ds_developer · Post by **ds_developer** » Mon Oct 15, 2007 1:49 pm

You are going to have to rethink your process. Parameters are set when the job starts running and they cannot be changed once the job is running. I believe this idea has been covered enough times successfully for you to be able to find the answer by searching the forum.

John

kranthi · Post by **kranthi** » Mon Oct 15, 2007 1:57 pm

Sorry, I am new to data stage and trying out a way.

Is there a way I can set the job parameters before running the job using before-job routine? I want to dynamically set the parameter values instead of setting a defualt value.

Thanks in advance
kk

jdmiceli · Post by **jdmiceli** » Mon Oct 15, 2007 1:57 pm

Take a look at Ken Bland's job control process and code. You can download it from free from his website (which I can't remember off the top of my head right now). Sign up for his free membership and go download the utilities and documentation he makes available there.

In it you will find exactly what you need to have to successfully perform the functions you are wanting.

Bestest!

kranthi · Post by **kranthi** » Mon Oct 15, 2007 2:58 pm

okay, I figured I can achieve this using job control process. But is it possible in a parallel job? All the threads I read in this forum direct me to a sequence job. Can you please provide me an example if any.

Thanks,
kk

jdmiceli · Post by **jdmiceli** » Mon Oct 15, 2007 3:10 pm

Sorry, I've only gotten to work with Server so I can't speak to what Parallel can do. I'm assuming there is functionality there for it, but I would not be a good source for it. I know there are plenty of other gurus on this site who can though.

Give it a few hours and someone will take a shot at it.

Bestest!

ray.wurlod · Post by **ray.wurlod** » Mon Oct 15, 2007 4:25 pm

The way that job parameters are set for parallel jobs (ultimately via a call to DSSetParam() function) is identical to the way the job parameters are set for server jobs and job sequences.

kranthi · Post by **kranthi** » Mon Oct 15, 2007 4:39 pm

Hi Ray,

Can you please provide an example? Can I use DSSetParam() in my unix script to set parameters?

If yes, that is exactly what I am doing right now. Here is my unix script.

#!/bin/sh

DSSetParam(PJ_OCC_EVE_ETL_commcommunicatn, "insert_cnt", "cat "$1" | grep 'insert_cnt">.*<' | cut -d">" -f4 | cut -d"<" -f1")

DSSetParam(PJ_OCC_EVE_ETL_commcommunicatn, "update_cnt", "cat "$1" | grep 'update_cnt">.*<' | cut -d">" -f6 | cut -d"<" -f1")

DSSetParam(PJ_OCC_EVE_ETL_commcommunicatn, "delete_cnt", "cat "$1" | grep 'delete_cnt">.*<' | cut -d">" -f8 | cut -d"<" -f1")

Am I missing anything here?

KK

ray.wurlod · Post by **ray.wurlod** » Mon Oct 15, 2007 4:52 pm

DSSetParam() is not invoked from UNIX - hence my use of the word "ultimately".

If you're using the dsjob command line interface include as many -param name=value options as you require, or use a parameter file. Search the forum for details of each approach.

kranthi · Post by **kranthi** » Tue Oct 16, 2007 10:27 am

Hi,

Can you tell me how do I make a call to DSSetParams using unix script. My requirement is to set three job parameters using unix script and use these job parameters in the transformer stage. I am not executing anything at command promt. All this has to happen while runtime.

I tried to include my unix script in the before-job subroutine, but it doesn't like DSSetParams() call in the script.

Please advise.

KK

ray.wurlod · Post by **ray.wurlod** » Tue Oct 16, 2007 1:42 pm

I just did.

DSSetParam() is a DataStage BASIC function. It also exists in the DataStage C language API. It can not be called from UNIX. You can write a small C program if you wish.